{"id":17008,"date":"2020-04-19T06:42:09","date_gmt":"2020-04-19T10:42:09","guid":{"rendered":"https:\/\/bangla.salearningschool.com\/recent-posts\/python-ecommerce-part-7-partition-a-data-file-with-product-information-into-multiple-files\/"},"modified":"2020-04-19T15:08:46","modified_gmt":"2020-04-19T19:08:46","slug":"python-ecommerce-part-7-partition-a-data-file-with-product-information-into-multiple-files","status":"publish","type":"post","link":"http:\/\/bangla.sitestree.com\/?p=17008","title":{"rendered":"Python: Ecommerce: Part \u2014 7: Partition a Data File (with product information) into Multiple Files."},"content":{"rendered":"
\n
\n
\n
\n
\n

In previous steps, we created a product data file to be uploaded to Magento 2 (from supplier data). However, there is a limit, how big a file can be uploaded to Magento 2 for product data import. Hence, this code will divide the data file into multiple files. This data file does not include image URLs. We will go there. If you have image URLs, magento upload process can upload images as well. In that case, the file becomes big as well as the product update can take a long time.<\/p>\n

magento_2_upload_file_with_data_no_desc.to_csv( output_folder +<\/strong> 'no-image-all_to_upload_without_description_' +<\/strong> input_file_name +<\/strong> '_magento_2_' +<\/strong> today +<\/strong> '.csv',index=False<\/strong>, encoding=<\/strong>'utf8')<\/span><\/pre>\n
In [98]:<\/p>\n
# divide the output into multiple files<\/em><\/p>\n
In [99]:<\/p>\n
partition =<\/strong> 20<\/span>increment =<\/strong>  int(round(magento_2_upload_file_with_data_no_desc.shape[0]\/<\/strong>partition,0)) +<\/strong> 1<\/span>increment<\/span>start =<\/strong> 0<\/span>for<\/strong> count in<\/strong> range(0, partition):<\/span>   start +=<\/strong> increment<\/span>   p =<\/strong> magento_2_upload_file_with_data_no_desc[start:start +<\/strong> increment]<\/span>   #print(p.head(1))<\/em><\/span>   p.to_csv(output_folder +<\/strong> 'partition-' +<\/strong> str(count) +<\/strong> '-no-image-  magento2_all_to_upload_with_description_' +<\/strong> today +<\/strong> '.csv', index=False<\/strong>);<\/span><\/pre>\n
All code in One Block<\/h1>\n
# divide the output into multiple files<\/span># In[106]:<\/span>partition = 20\nincrement = int(round(magento_2_upload_file_with_data_no_desc.shape[0]\/partition,0)) + 1\nincrement<\/span>start = 0\nfor count in range(0, partition):\n start += increment\n p = magento_2_upload_file_with_data_no_desc[start:start + increment]\n #print(p.head(1))\n p.to_csv(output_folder + \u2018partition-\u2019 + str(count) + \u2018-no-image-magento2_all_to_upload_with_description_\u2019 + today + \u2018.csv\u2019, index=False);<\/span># In[107]:<\/span><\/pre>\n
Medium:\u00a0<\/em><\/strong>https:\/\/medium.com\/@SayedAhmedCanada<\/a><\/h1>\n
*** . *** *** . *** . *** . ***<\/p>\n
Sayed Ahmed<\/em><\/strong><\/p>\n
BSc. Eng. in Comp. Sc. & Eng. (BUET)<\/em><\/strong><\/p>\n
MSc. in Comp. Sc. (U of Manitoba, Canada)<\/em><\/strong><\/p>\n
MSc. in Data Science and Analytics (Ryerson University, Canada)<\/em><\/strong><\/p>\n
Linkedin<\/em><\/strong>:\u00a0<\/em>https:\/\/ca.linkedin.com\/in\/sayedjustetc<\/em><\/a><\/p>\n
Blog<\/em><\/strong>:\u00a0<\/em>http:\/\/Bangla.SaLearningSchool.com<\/em><\/a>,\u00a0<\/em>http:\/\/SitesTree.com<\/em><\/a><\/p>\n
Training Courses:\u00a0<\/em><\/strong>http:\/\/Training.SitesTree.com<\/em><\/a><\/p>\n
8112223 Canada Inc\/Justetc<\/em><\/strong>:\u00a0<\/em>http:\/\/JustEtc.net<\/em><\/a><\/p>\n
Facebook Groups\/Forums to discuss (Q & A):<\/em><\/strong><\/p>\n
https:\/\/www.facebook.com\/banglasalearningschool<\/a><\/p>\n
https:\/\/www.facebook.com\/justetcsocial<\/a><\/p>\n
Get access to courses on Big Data, Data Science, AI, Cloud, Linux, System Admin, Web Development and Misc. related. Also, create your own course to sell to others.\u00a0<\/em>http:\/\/sitestree.com\/training\/<\/a><\/p>\n<\/div>\n<\/div>\n<\/section>\n<\/div>\n<\/article>\n
\n
\n
\n
\n
\n
\n
Build Ecommerce Software and Systems<\/h2>\n
\n
Build Ecommerce Software and Systems<\/h4>\n<\/div>\n