[InterMine Dev] Integration of huge amount data
chenyian at nibio.go.jp
Mon Feb 13 09:29:44 GMT 2012
Dose anyone have any experience about integrating large quantity data
into InterMine system?
I've tried to incorporate gene3d domain assignment, which contains 16m
assignments for 15m proteins.
I think I might have created more than 30m objects during integration.
When storing these items, it took very long time and I couldn't finish
it within 15 hours (I gave up finally).
More information about the dev