[InterMine Dev] Integration of huge amount data

Chen Yian chenyian at nibio.go.jp
Mon Feb 13 09:29:44 GMT 2012


Hi all,

Dose anyone have any experience about integrating large quantity data 
into InterMine system?
I've tried to incorporate gene3d domain assignment, which contains 16m 
assignments for 15m proteins.
I think I might have created more than 30m objects during integration.
When storing these items, it took very long time and I couldn't finish 
it within 15 hours (I gave up finally).
Any suggestion?

Thank you.

Best,

Chen




More information about the dev mailing list