I wanted to call sqoop export command in my pig script, Basically once I stored my result immediatlyy i wanted to call sqoop export cmd. Is it possible ? If Yes please let me know how to call .
Thanks Selvam
No, you can't do Sqoop export from Apache Pig. Most likely you need to use HCatStorer of HCatalog project. Then you can set the HCatalog table with the HCatalog export option in Apache Sqoop. But I haven't done this before.
Are you planning to run such workflow periodically or just one time? I'm assuming that it's not one time as then it would be very easy to just call Sqoop after the Pig script. I would recommend you taking a look into Oozie for automating workflows with multiple steps. If you do not prefer writing the workflow XML yourself, take a look at Hue Oozie App that is extremely user friendly.
I wanted to call sqoop export command in my pig script, Basically once I stored my result immediatlyy i wanted to call sqoop export cmd. Is it possible ? If Yes please let me know how to call .
Thanks Selvam
No, you can't do Sqoop export from Apache Pig. Most likely you need to use HCatStorer of HCatalog project. Then you can set the HCatalog table with the HCatalog export option in Apache Sqoop. But I haven't done this before.
Are you planning to run such workflow periodically or just one time? I'm assuming that it's not one time as then it would be very easy to just call Sqoop after the Pig script. I would recommend you taking a look into Oozie for automating workflows with multiple steps. If you do not prefer writing the workflow XML yourself, take a look at Hue Oozie App that is extremely user friendly.
0 commentaires:
Enregistrer un commentaire