{"id":17007,"date":"2020-04-19T06:41:17","date_gmt":"2020-04-19T10:41:17","guid":{"rendered":"https:\/\/bangla.salearningschool.com\/recent-posts\/python-ecommerce-part-6-format-and-adjust-your-product-data-and-price-data-to-save-to-a-csv-to-upload-to-magento-2\/"},"modified":"2020-04-19T15:10:05","modified_gmt":"2020-04-19T19:10:05","slug":"python-ecommerce-part-6-format-and-adjust-your-product-data-and-price-data-to-save-to-a-csv-to-upload-to-magento-2","status":"publish","type":"post","link":"http:\/\/bangla.sitestree.com\/?p=17007","title":{"rendered":"Python: Ecommerce: Part \u2014 6: Format and adjust your product data and price data to save to a csv to upload to Magento 2."},"content":{"rendered":"
\n
\n
\n
\n
\n
\n
\n
\n

Code will be given cell by cell from Jupyter Notebook. Then will also give all code in one block. You might need to adjust the indenting a bit.<\/span><\/h4>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n

Read the code comments as well. Comments explained the sections.<\/p>\n

In [86]:<\/p>\n

# calculate\/adjust data so that we can create magento 2 upload files<\/em><\/p>\n

# csv file to upload to Magento 2<\/em><\/p>\n

In [88]:<\/p>\n

# load the template : i.e. columns required for magento 2 upload<\/em><\/p>\n

magento_2_upload_template_file =<\/strong> template_folder  +<\/strong> 'magento2_catalog_product.csv' #'all-to-upload-without-description.csv'<\/em><\/span>magento_2_upload_template_file =<\/strong> pd.read_csv(magento_2_upload_template_file)<\/span><\/pre>\n
In [89]:<\/p>\n
magento_2_upload_template_file.columns<\/span><\/pre>\n
Out[89]:<\/p>\n
Index(['sku', 'store_view_code', 'attribute_set_code', 'product_type',\n       'categories', 'product_websites', 'name', 'description',\n       'short_description', 'weight', 'product_online', 'tax_class_name',\n       'visibility', 'price', 'special_price', 'special_price_from_date',\n       'special_price_to_date', 'url_key', 'meta_title', 'meta_keywords',\n       'meta_description', 'created_at', 'updated_at', 'new_from_date',\n       'new_to_date', 'display_product_options_in', 'map_price', 'msrp_price',\n       'map_enabled', 'gift_message_available', 'custom_design',\n       'custom_design_from', 'custom_design_to', 'custom_layout_update',\n       'page_layout', 'product_options_container',\n       'msrp_display_actual_price_type', 'country_of_manufacture',\n       'additional_attributes', 'qty', 'out_of_stock_qty',\n       'use_config_min_qty', 'is_qty_decimal', 'allow_backorders',\n       'use_config_backorders', 'min_cart_qty', 'use_config_min_sale_qty',\n       'max_cart_qty', 'use_config_max_sale_qty', 'is_in_stock',\n       'notify_on_stock_below', 'use_config_notify_stock_qty', 'manage_stock',\n       'use_config_manage_stock', 'use_config_qty_increments',\n       'qty_increments', 'use_config_enable_qty_inc', 'enable_qty_increments',\n       'is_decimal_divided', 'website_id', 'deferred_stock_update',\n       'use_config_deferred_stock_update', 'related_skus', 'crosssell_skus',\n       'upsell_skus', 'hide_from_product_page', 'custom_options',\n       'bundle_price_type', 'bundle_sku_type', 'bundle_price_view',\n       'bundle_weight_type', 'bundle_values', 'associated_skus'],\n      dtype='object')<\/span><\/pre>\n
In [90]:<\/p>\n
price_calculation_df.columns<\/span><\/pre>\n
Out[90]:<\/p>\n
Index(['product_id', 'sku', 'Name', 'raw_price', 'Postal Shipping Price',\n       'cheapest_courier_shipping', 'product_ean', 'Ship Risk', 'Price Risk',\n       'Total', 'Risk Return', 'Total with ship', 'Referral Fee',\n       'Paypal Fees', 'Final Value Fee', 'Insertion Fee', 'HST', 'EU Vat',\n       'Currency Risk', 'shopforsoul_profit', 'ebay_profit', 'Income Tax',\n       'shopforsoul_cost', 'MLP', 'Special List Price', 'special_from_date',\n       'special_to_date', 'ebay_cost', 'ebay_list_price',\n       'Buyer pay from Mall', 'Ebay Buyers Pay', 'Ebay vs Mall', 'NA-1',\n       'amazon_profit', 'amazon_our_cost', 'Amazon Final Value Fee',\n       'amazon_list_price', 'amazon_special_price',\n       'Amazon Final Value Fee USD', 'amazon_profit_usd',\n       'amazon_our_cost_usd', 'amazon_list_price_usd',\n       'amazon_special_price_usd', 'amazon_list_price_gbp',\n       'amazon_special_price_gbp', 'amazon_list_price_eu',\n       'amazon_special_price_eu', 'amazon_list_price_mxn',\n       'amazon_special_price_mxn', 'ama_safe_refund_amount', 'Weight',\n       'original in stock', 'Stock status', 'categories', '_root_category',\n       'visibility', 'Height mm', 'Width mm', 'Depth mm', 'status',\n       'weight right', 'Ship Right', 'Soon Discontinued', 'Is Normal',\n       'Retail Price', 'R+shipp', 'Shop vs retail', 'amazon_ca_minimum_price',\n       'amazon_usd_minimum_price', 'amazon_gbp_minimum_price',\n       'amazon_eu_minimum_price', 'amazon_mxn_minimum', 'expedited_cost',\n       'amazon_ca_abs_minimum'],\n      dtype='object')<\/span><\/pre>\n
In [91]:<\/p>\n
price_calculation_df.rename(columns=<\/strong>{'Height mm': 'height'}, inplace=True<\/strong>)<\/span>price_calculation_df.rename(columns=<\/strong>{'Depth mm': 'length', 'Width mm': 'width'}, inplace=True<\/strong>)<\/span>price_calculation_df.rename(columns=<\/strong>{'Special List Price':'special_price', 'MLP':'price', 'Stock status':'is_in_stock'}, inplace=True<\/strong>)<\/span>#amazon_our_cost_usd<\/em><\/span>price_calculation_df.rename(columns=<\/strong>{'Name':'name', 'Weight':'weight'}, inplace=True<\/strong>)  #, 'use_config_min_qty', 'visibility'<\/em><\/span><\/pre>\n
In [92]:<\/p>\n
# set some default values that you want to upload to Magento 2<\/em><\/p>\n
# default values are in list format so that it can be aligned with other data<\/em><\/p>\n
In [93]:<\/p>\n
type =<\/strong> ['simple'] *<\/strong> price_calculation_df.shape[0]<\/span>_attribute_set =<\/strong> ['Default'] *<\/strong> price_calculation_df.shape[0]<\/span>qty =<\/strong> [10] *<\/strong> price_calculation_df.shape[0]<\/span>min_qty =<\/strong> [1] *<\/strong> price_calculation_df.shape[0]<\/span>use_config_min_qty =<\/strong> [1] *<\/strong> price_calculation_df.shape[0]<\/span>is_qty_decimal =<\/strong> [0] *<\/strong> price_calculation_df.shape[0]<\/span>backorders =<\/strong> [0] *<\/strong> price_calculation_df.shape[0]<\/span>use_config_backorders =<\/strong> [1] *<\/strong> price_calculation_df.shape[0]<\/span>min_sale_qty =<\/strong> [1] *<\/strong> price_calculation_df.shape[0]<\/span>use_config_min_sale_qty =<\/strong> [1] *<\/strong> price_calculation_df.shape[0]<\/span>max_sale_qty =<\/strong> [2] *<\/strong> price_calculation_df.shape[0]<\/span>use_config_max_sale_qty =<\/strong> [1] *<\/strong> price_calculation_df.shape[0]<\/span>notify_stock_qty =<\/strong> [0] *<\/strong> price_calculation_df.shape[0]<\/span>use_config_notify_stock_qty =<\/strong> [1] *<\/strong> price_calculation_df.shape[0]<\/span>manage_stock =<\/strong> [0] *<\/strong> price_calculation_df.shape[0]<\/span>use_config_manage_stock =<\/strong> [1] *<\/strong> price_calculation_df.shape[0]<\/span>stock_status_changed_auto =<\/strong> [0] *<\/strong> price_calculation_df.shape[0]<\/span>use_config_qty_increments =<\/strong> [1] *<\/strong> price_calculation_df.shape[0]<\/span>qty_increments =<\/strong> [0] *<\/strong> price_calculation_df.shape[0]<\/span>use_config_enable_qty_inc =<\/strong> [1] *<\/strong> price_calculation_df.shape[0]<\/span>enable_qty_increments =<\/strong> [0] *<\/strong> price_calculation_df.shape[0]<\/span>is_decimal_divided =<\/strong> [0] *<\/strong> price_calculation_df.shape[0]<\/span>_media_is_disabled =<\/strong> [0] *<\/strong> price_calculation_df.shape[0]<\/span>tax_class_id =<\/strong> [2] *<\/strong> price_calculation_df.shape[0]<\/span><\/pre>\n
In [94]:<\/p>\n
# creating dataframe to store data to upload to Magento 2<\/em><\/p>\n
# this dataframe will be saved to a csv file<\/em><\/p>\n
In [95]:<\/p>\n
magento_2_upload_file_with_data_no_desc =<\/strong> price_calculation_df[[<\/span>'sku',<\/span>#'store_view_code',<\/em><\/span>#'attribute_set_code',<\/em><\/span>#'product_type',<\/em><\/span>#'categories',<\/em><\/span>#'product_websites', 'name',<\/em><\/span>#'description',<\/em><\/span>#'short_description',<\/em><\/span>'weight',<\/span>#'product_online',<\/em><\/span>#'tax_class_name',<\/em><\/span>#'visibility',<\/em><\/span>'price',<\/span>'special_price',<\/span>#'special_price_from_date',<\/em><\/span>#'special_price_to_date',<\/em><\/span>#'url_key',<\/em><\/span>#'meta_title',<\/em><\/span>#'meta_keywords',<\/em><\/span>#'meta_description',<\/em><\/span>#'created_at',<\/em><\/span>#'updated_at',<\/em><\/span>#'new_from_date',<\/em><\/span>#'new_to_date',<\/em><\/span>#'display_product_options_in',<\/em><\/span>#'map_price', 'msrp_price',<\/em><\/span>#'map_enabled',<\/em><\/span>#'gift_message_available',<\/em><\/span>#'custom_design',<\/em><\/span>#'custom_design_from',<\/em><\/span>#'custom_design_to',<\/em><\/span>#'custom_layout_update',<\/em><\/span>#'page_layout',<\/em><\/span>#'product_options_container',<\/em><\/span>#'msrp_display_actual_price_type',<\/em><\/span>#'country_of_manufacture',<\/em><\/span>#'additional_attributes',<\/em><\/span>#'qty',<\/em><\/span>#'out_of_stock_qty',<\/em><\/span>#'use_config_min_qty',<\/em><\/span>#'is_qty_decimal',<\/em><\/span>#'allow_backorders',<\/em><\/span>#'use_config_backorders',<\/em><\/span>#'min_cart_qty',<\/em><\/span>#'use_config_min_sale_qty',<\/em><\/span>#'max_cart_qty',<\/em><\/span>#'use_config_max_sale_qty',<\/em><\/span>'is_in_stock',<\/span>#'notify_on_stock_below',<\/em><\/span>#'use_config_notify_stock_qty',<\/em><\/span>#'manage_stock',<\/em><\/span>#'use_config_manage_stock',<\/em><\/span>#'use_config_qty_increments',<\/em><\/span>#'qty_increments',<\/em><\/span>#'use_config_enable_qty_inc',<\/em><\/span>#'enable_qty_increments',<\/em><\/span>#'is_decimal_divided',<\/em><\/span>#'website_id',<\/em><\/span>#'deferred_stock_update',<\/em><\/span>#'use_config_deferred_stock_update',<\/em><\/span>#'related_skus',<\/em><\/span>#'crosssell_skus',<\/em><\/span>#'upsell_skus',<\/em><\/span>#'hide_from_product_page',<\/em><\/span>#'custom_options',<\/em><\/span>#'bundle_price_type', 'bundle_sku_type', 'bundle_price_view',<\/em><\/span>#'bundle_weight_type', 'bundle_values', 'associated_skus'<\/em><\/span>]]<\/span>magento_2_upload_file_with_data_no_desc =<\/strong> price_calculation_df[['product_id', 'sku', 'name', 'raw_price',<\/span>#'dummy',<\/em><\/span>'cheapest_courier_shipping', 'product_ean', 'shopforsoul_profit',<\/span>'ebay_profit', 'shopforsoul_cost', 'price', 'special_price',<\/span>'special_from_date', 'special_to_date', 'ebay_cost', 'ebay_list_price',<\/span>'amazon_profit',<\/span>'amazon_our_cost', 'amazon_list_price',<\/span>'amazon_special_price', 'amazon_list_price_usd',<\/span>'amazon_special_price_usd', 'amazon_list_price_gbp',<\/span>'amazon_special_price_gbp', 'amazon_list_price_eu',<\/span>'amazon_special_price_eu', 'weight', 'is_in_stock', 'categories',<\/span>#'_root_category',<\/em><\/span>'visibility',<\/span>'height', 'width',<\/span>'length',<\/span>'status',<\/span>#'_type', '_attribute_set', 'qty', 'min_qty',<\/em><\/span>#'use_config_min_qty',<\/em><\/span>#'is_qty_decimal', 'backorders',<\/em><\/span>#'use_config_backorders', 'min_sale_qty', 'use_config_min_sale_qty',<\/em><\/span>#'max_sale_qty', 'use_config_max_sale_qty', 'notify_stock_qty',<\/em><\/span>#'use_config_notify_stock_qty', 'manage_stock',<\/em><\/span>#'use_config_manage_stock', 'stock_status_changed_auto',<\/em><\/span>#'use_config_qty_increments', 'qty_increments',<\/em><\/span>#'use_config_enable_qty_inc', 'enable_qty_increments',<\/em><\/span>#'is_decimal_divided', '_media_is_disabled',<\/em><\/span>#'tax_class_id'<\/em><\/span>]]<\/span><\/pre>\n
In [ ]:<\/p>\n
magento_2_upload_file_with_data_no_desc<\/span><\/pre>\n
In [ ]:<\/p>\n
#df_new_template['categories']<\/em><\/span><\/pre>\n
In [96]:<\/p>\n
# set some more default values for magento 2<\/em><\/span><\/pre>\n
In [97]:<\/p>\n
magento_2_upload_file_with_data_no_desc['attribute_set_code'] =<\/strong> 'Default'<\/span>#magento_2_upload_file_with_data_no_desc['categories'] =<\/em><\/span>#magento_2_upload_file_with_data_no_desc['height'] =<\/em><\/span>#magento_2_upload_file_with_data_no_desc['length'] =<\/em><\/span>magento_2_upload_file_with_data_no_desc['product_online'] =<\/strong> 1<\/span>magento_2_upload_file_with_data_no_desc['product_type'] =<\/strong> 'simple'<\/span>magento_2_upload_file_with_data_no_desc['product_websites'] =<\/strong> 'base'<\/span>magento_2_upload_file_with_data_no_desc['root_category'] =<\/strong> 'All'<\/span>magento_2_upload_file_with_data_no_desc['store_view_code'] =<\/strong> ''<\/span>magento_2_upload_file_with_data_no_desc['tax_class_name'] =<\/strong> 'Taxable Goods'<\/span>#magento_2_upload_file_with_data_no_desc['width'] =<\/em><\/span><\/pre>\n
take the default values set before in the section marked as<\/h1>\n
Check couple of steps up \u201c<\/p>\n
#set some default values that you want to upload to Magento 2<\/p>\n
#default values are in list format so that it can be aligned with other data \u201c<\/p>\n
In [99]:<\/p>\n
magento_2_upload_file_with_data_no_desc<\/span>#magento_2_upload_file_with_data_no_desc['_type'] = type<\/em><\/span>magento_2_upload_file_with_data_no_desc['_attribute_set'] =<\/strong> _attribute_set<\/span>magento_2_upload_file_with_data_no_desc['qty'] =<\/strong> qty<\/span>magento_2_upload_file_with_data_no_desc['min_qty'] =<\/strong> min_qty<\/span>magento_2_upload_file_with_data_no_desc['use_config_min_qty'] =<\/strong> use_config_min_qty<\/span>magento_2_upload_file_with_data_no_desc['is_qty_decimal'] =<\/strong> is_qty_decimal<\/span>magento_2_upload_file_with_data_no_desc['backorders'] =<\/strong> backorders<\/span>magento_2_upload_file_with_data_no_desc['use_config_backorders'] =<\/strong> use_config_backorders<\/span>magento_2_upload_file_with_data_no_desc['min_sale_qty'] =<\/strong> min_sale_qty<\/span>magento_2_upload_file_with_data_no_desc['use_config_min_sale_qty'] =<\/strong> use_config_min_sale_qty<\/span>magento_2_upload_file_with_data_no_desc['max_sale_qty'] =<\/strong> max_sale_qty<\/span>magento_2_upload_file_with_data_no_desc['use_config_max_sale_qty'] =<\/strong> use_config_max_sale_qty<\/span>magento_2_upload_file_with_data_no_desc['notify_stock_qty'] =<\/strong> notify_stock_qty<\/span>magento_2_upload_file_with_data_no_desc['use_config_notify_stock_qty'] =<\/strong> use_config_notify_stock_qty<\/span>magento_2_upload_file_with_data_no_desc['manage_stock'] =<\/strong> manage_stock<\/span>magento_2_upload_file_with_data_no_desc['use_config_manage_stock'] =<\/strong> use_config_manage_stock<\/span>magento_2_upload_file_with_data_no_desc['stock_status_changed_auto'] =<\/strong> stock_status_changed_auto<\/span>magento_2_upload_file_with_data_no_desc['use_config_qty_increments'] =<\/strong> use_config_qty_increments<\/span>magento_2_upload_file_with_data_no_desc['qty_increments'] =<\/strong> qty_increments<\/span>magento_2_upload_file_with_data_no_desc['use_config_enable_qty_inc'] =<\/strong> use_config_enable_qty_inc<\/span>magento_2_upload_file_with_data_no_desc['enable_qty_increments'] =<\/strong> enable_qty_increments<\/span>magento_2_upload_file_with_data_no_desc['is_decimal_divided'] =<\/strong> is_decimal_divided<\/span>magento_2_upload_file_with_data_no_desc['_media_is_disabled'] =<\/strong> _media_is_disabled<\/span>magento_2_upload_file_with_data_no_desc['tax_class_id'] =<\/strong> tax_class_id<\/span><\/pre>\n
In [100]:<\/p>\n
#magento_2_upload_file_with_data_no_desc['categories'] = magento_1_upload_file_with_data_no_desc['_category']<\/em><\/span><\/pre>\n
In [101]:<\/p>\n
magento_2_upload_file_with_data_no_desc['visibility'] =<\/strong> BC2<\/span><\/pre>\n
In [102]:<\/p>\n
#magento_1_upload_file_with_data_no_desc.drop( columns = \"\", axis=1)<\/em><\/span>magento_2_upload_file_with_data_no_desc.columns<\/span><\/pre>\n
Out[102]:<\/p>\n
Index(['product_id', 'sku', 'name', 'raw_price', 'cheapest_courier_shipping',\n       'product_ean', 'shopforsoul_profit', 'ebay_profit', 'shopforsoul_cost',\n       'price', 'special_price', 'special_from_date', 'special_to_date',\n       'ebay_cost', 'ebay_list_price', 'amazon_profit', 'amazon_our_cost',\n       'amazon_list_price', 'amazon_special_price', 'amazon_list_price_usd',\n       'amazon_special_price_usd', 'amazon_list_price_gbp',\n       'amazon_special_price_gbp', 'amazon_list_price_eu',\n       'amazon_special_price_eu', 'weight', 'is_in_stock', 'categories',\n       'visibility', 'height', 'width', 'length', 'status',\n       'attribute_set_code', 'product_online', 'product_type',\n       'product_websites', 'root_category', 'store_view_code',\n       'tax_class_name', '_attribute_set', 'qty', 'min_qty',\n       'use_config_min_qty', 'is_qty_decimal', 'backorders',\n       'use_config_backorders', 'min_sale_qty', 'use_config_min_sale_qty',\n       'max_sale_qty', 'use_config_max_sale_qty', 'notify_stock_qty',\n       'use_config_notify_stock_qty', 'manage_stock',\n       'use_config_manage_stock', 'stock_status_changed_auto',\n       'use_config_qty_increments', 'qty_increments',\n       'use_config_enable_qty_inc', 'enable_qty_increments',\n       'is_decimal_divided', '_media_is_disabled', 'tax_class_id'],\n      dtype='object')<\/span><\/pre>\n
In [103]:<\/p>\n
# drop products with the same sku<\/em><\/span><\/pre>\n
In [104]:<\/p>\n
#magento_1_upload_file_with_data_no_desc.drop(['categories'], inplace=True, axis=1)<\/em><\/span># sorting by first name<\/em><\/span>#magento_1_upload_file_with_data_no_desc.sort_values(\"sku\", inplace = True)<\/em><\/span># dropping ALL duplicte values<\/em><\/span>magento_2_upload_file_with_data_no_desc.drop_duplicates(subset =<\/strong>\"sku\", keep =<\/strong> False<\/strong>, inplace =<\/strong> True<\/strong>)<\/span><\/pre>\n
In [ ]:<\/p>\n
# save the output file i.e. to load to magento 2<\/em><\/p>\n
# no image data\/url as part of the upload file<\/em><\/p>\n
In [105]:<\/p>\n
#output_folder = '.\/data-supplier-20219-04-14\/output\/';<\/em><\/span>magento_2_upload_file_with_data_no_desc.to_csv( output_folder +<\/strong> 'no-image-all_to_upload_without_description_' +<\/strong> input_file_name +<\/strong> '_magento_2_' +<\/strong> today +<\/strong> '.csv',index=False<\/strong>, encoding=<\/strong>'utf8')<\/span><\/pre>\n
In [ ]:<\/p>\n
# divide the output into multiple files<\/em><\/span><\/pre>\n
All code in one block. Still indenting might be required<\/p>\n
# In[86]:<\/span># calculate\/adjust data so that we can create magento 2 upload files\n# csv file to upload to Magento 2<\/span># In[88]:<\/span># load the template : i.e. columns required for magento 2 upload\nmagento_2_upload_template_file = template_folder + \u2018magento2_catalog_product.csv\u2019 #\u2019all-to-upload-without-description.csv\u2019\nmagento_2_upload_template_file = pd.read_csv(magento_2_upload_template_file)<\/span># In[89]:<\/span>magento_2_upload_template_file.columns<\/span># In[90]:<\/span>price_calculation_df.columns<\/span># In[91]:<\/span>price_calculation_df.rename(columns={\u2018Height mm\u2019: \u2018height\u2019}, inplace=True)\nprice_calculation_df.rename(columns={\u2018Depth mm\u2019: \u2018length\u2019, \u2018Width mm\u2019: \u2018width\u2019}, inplace=True)\nprice_calculation_df.rename(columns={\u2018Special List Price\u2019:\u2019special_price\u2019, \u2018MLP\u2019:\u2019price\u2019, \u2018Stock status\u2019:\u2019is_in_stock\u2019}, inplace=True)\n#amazon_our_cost_usd\nprice_calculation_df.rename(columns={\u2018Name\u2019:\u2019name\u2019, \u2018Weight\u2019:\u2019weight\u2019}, inplace=True) #, \u2018use_config_min_qty\u2019, \u2018visibility\u2019<\/span># In[92]:<\/span># set some default values that you want to upload to Magento 2\n# default values are in list format so that it can be aligned with other data<\/span># In[93]:<\/span>type = [\u2018simple\u2019] * price_calculation_df.shape[0]\n_attribute_set = [\u2018Default\u2019] * price_calculation_df.shape[0]\nqty = [10] * price_calculation_df.shape[0]\nmin_qty = [1] * price_calculation_df.shape[0]\nuse_config_min_qty = [1] * price_calculation_df.shape[0]\nis_qty_decimal = [0] * price_calculation_df.shape[0]\nbackorders = [0] * price_calculation_df.shape[0]\nuse_config_backorders = [1] * price_calculation_df.shape[0]\nmin_sale_qty = [1] * price_calculation_df.shape[0]\nuse_config_min_sale_qty = [1] * price_calculation_df.shape[0]\nmax_sale_qty = [2] * price_calculation_df.shape[0]\nuse_config_max_sale_qty = [1] * price_calculation_df.shape[0]\nnotify_stock_qty = [0] * price_calculation_df.shape[0]\nuse_config_notify_stock_qty = [1] * price_calculation_df.shape[0]\nmanage_stock = [0] * price_calculation_df.shape[0]\nuse_config_manage_stock = [1] * price_calculation_df.shape[0]\nstock_status_changed_auto = [0] * price_calculation_df.shape[0]\nuse_config_qty_increments = [1] * price_calculation_df.shape[0]\nqty_increments = [0] * price_calculation_df.shape[0]\nuse_config_enable_qty_inc = [1] * price_calculation_df.shape[0]\nenable_qty_increments = [0] * price_calculation_df.shape[0]\nis_decimal_divided = [0] * price_calculation_df.shape[0]\n_media_is_disabled = [0] * price_calculation_df.shape[0]\ntax_class_id = [2] * price_calculation_df.shape[0]<\/span># In[94]:<\/span># creatinf dataframe to store data to upload to Magento 2\n# this dataframe will be saved to a csv file<\/span># In[95]:<\/span>magento_2_upload_file_with_data_no_desc = price_calculation_df[[\n \u2018sku\u2019, \n #\u2019store_view_code\u2019, \n #\u2019attribute_set_code\u2019, \n #\u2019product_type\u2019,\n #\u2019categories\u2019, \n #\u2019product_websites\u2019, \u2018name\u2019, \n #\u2019description\u2019,\n #\u2019short_description\u2019, \n \u2018weight\u2019, \n #\u2019product_online\u2019, \n #\u2019tax_class_name\u2019,\n #\u2019visibility\u2019, \n \u2018price\u2019, \n \u2018special_price\u2019, \n #\u2019special_price_from_date\u2019,\n #\u2019special_price_to_date\u2019, \n #\u2019url_key\u2019, \n #\u2019meta_title\u2019, \n #\u2019meta_keywords\u2019,\n #\u2019meta_description\u2019, \n #\u2019created_at\u2019, \n #\u2019updated_at\u2019, \n #\u2019new_from_date\u2019,\n #\u2019new_to_date\u2019, \n #\u2019display_product_options_in\u2019, \n #\u2019map_price\u2019, \u2018msrp_price\u2019,\n #\u2019map_enabled\u2019, \n #\u2019gift_message_available\u2019, \n #\u2019custom_design\u2019,\n #\u2019custom_design_from\u2019, \n #\u2019custom_design_to\u2019, \n #\u2019custom_layout_update\u2019,\n #\u2019page_layout\u2019, \n #\u2019product_options_container\u2019,\n #\u2019msrp_display_actual_price_type\u2019, \n #\u2019country_of_manufacture\u2019,\n #\u2019additional_attributes\u2019, \n #\u2019qty\u2019, \n #\u2019out_of_stock_qty\u2019,\n #\u2019use_config_min_qty\u2019, \n #\u2019is_qty_decimal\u2019, \n #\u2019allow_backorders\u2019,\n #\u2019use_config_backorders\u2019, \n #\u2019min_cart_qty\u2019, \n #\u2019use_config_min_sale_qty\u2019,\n #\u2019max_cart_qty\u2019, \n #\u2019use_config_max_sale_qty\u2019, \n \u2018is_in_stock\u2019,\n #\u2019notify_on_stock_below\u2019, \n #\u2019use_config_notify_stock_qty\u2019, \n #\u2019manage_stock\u2019,\n #\u2019use_config_manage_stock\u2019, \n #\u2019use_config_qty_increments\u2019,\n #\u2019qty_increments\u2019, \n #\u2019use_config_enable_qty_inc\u2019, \n \n #\u2019enable_qty_increments\u2019,\n #\u2019is_decimal_divided\u2019, \n #\u2019website_id\u2019, \n #\u2019deferred_stock_update\u2019,\n #\u2019use_config_deferred_stock_update\u2019, \n #\u2019related_skus\u2019, \n #\u2019crosssell_skus\u2019,\n #\u2019upsell_skus\u2019, \n #\u2019hide_from_product_page\u2019, \n #\u2019custom_options\u2019,\n \n #\u2019bundle_price_type\u2019, \u2018bundle_sku_type\u2019, \u2018bundle_price_view\u2019,\n #\u2019bundle_weight_type\u2019, \u2018bundle_values\u2019, \u2018associated_skus\u2019\n]]<\/span>magento_2_upload_file_with_data_no_desc = price_calculation_df[[\u2018product_id\u2019, \u2018sku\u2019, \u2018name\u2019, \u2018raw_price\u2019, \n #\u2019dummy\u2019,\n \u2018cheapest_courier_shipping\u2019, \u2018product_ean\u2019, \u2018shopforsoul_profit\u2019,\n \u2018ebay_profit\u2019, \u2018shopforsoul_cost\u2019, \u2018price\u2019, \u2018special_price\u2019,\n \u2018special_from_date\u2019, \u2018special_to_date\u2019, \u2018ebay_cost\u2019, \u2018ebay_list_price\u2019,\n \u2018amazon_profit\u2019, \n \u2018amazon_our_cost\u2019, \u2018amazon_list_price\u2019,\n \u2018amazon_special_price\u2019, \u2018amazon_list_price_usd\u2019,\n \u2018amazon_special_price_usd\u2019, \u2018amazon_list_price_gbp\u2019,\n \u2018amazon_special_price_gbp\u2019, \u2018amazon_list_price_eu\u2019,\n \u2018amazon_special_price_eu\u2019, \u2018weight\u2019, \u2018is_in_stock\u2019, \u2018categories\u2019,\n #\u2019_root_category\u2019, \n \u2018visibility\u2019, \n \u2018height\u2019, \u2018width\u2019,\n \u2018length\u2019, \n \u2018status\u2019, \n #\u2019_type\u2019, \u2018_attribute_set\u2019, \u2018qty\u2019, \u2018min_qty\u2019,\n #\u2019use_config_min_qty\u2019, \n #\u2019is_qty_decimal\u2019, \u2018backorders\u2019,\n #\u2019use_config_backorders\u2019, \u2018min_sale_qty\u2019, \u2018use_config_min_sale_qty\u2019,\n #\u2019max_sale_qty\u2019, \u2018use_config_max_sale_qty\u2019, \u2018notify_stock_qty\u2019,\n #\u2019use_config_notify_stock_qty\u2019, \u2018manage_stock\u2019,\n #\u2019use_config_manage_stock\u2019, \u2018stock_status_changed_auto\u2019,\n #\u2019use_config_qty_increments\u2019, \u2018qty_increments\u2019,\n #\u2019use_config_enable_qty_inc\u2019, \u2018enable_qty_increments\u2019,\n #\u2019is_decimal_divided\u2019, \u2018_media_is_disabled\u2019, \n #\u2019tax_class_id\u2019\n]]<\/span># In[ ]:<\/span>magento_2_upload_file_with_data_no_desc<\/span># In[ ]:<\/span>#df_new_template[\u2018categories\u2019]<\/span># In[96]:<\/span># set some more default values for magento 2<\/span># In[97]:<\/span>magento_2_upload_file_with_data_no_desc[\u2018attribute_set_code\u2019] = \u2018Default\u2019\n#magento_2_upload_file_with_data_no_desc[\u2018categories\u2019] = \n#magento_2_upload_file_with_data_no_desc[\u2018height\u2019] = \n#magento_2_upload_file_with_data_no_desc[\u2018length\u2019] = \nmagento_2_upload_file_with_data_no_desc[\u2018product_online\u2019] = 1\nmagento_2_upload_file_with_data_no_desc[\u2018product_type\u2019] = \u2018simple\u2019\nmagento_2_upload_file_with_data_no_desc[\u2018product_websites\u2019] = \u2018base\u2019\nmagento_2_upload_file_with_data_no_desc[\u2018root_category\u2019] = \u2018All\u2019\nmagento_2_upload_file_with_data_no_desc[\u2018store_view_code\u2019] = \u2018\u2019\nmagento_2_upload_file_with_data_no_desc[\u2018tax_class_name\u2019] = \u2018Taxable Goods\u2019\n#magento_2_upload_file_with_data_no_desc[\u2018width\u2019] =<\/span># # take the default values set before in the section marked as \n# Check couple of steps up\n# \u201c\n# #set some default values that you want to upload to Magento 2\n# #default values are in list format so that it can be aligned with other data\n# \u201c<\/span># In[99]:<\/span>magento_2_upload_file_with_data_no_desc\n#magento_2_upload_file_with_data_no_desc[\u2018_type\u2019] = type\nmagento_2_upload_file_with_data_no_desc[\u2018_attribute_set\u2019] = _attribute_set\nmagento_2_upload_file_with_data_no_desc[\u2018qty\u2019] = qty\nmagento_2_upload_file_with_data_no_desc[\u2018min_qty\u2019] = min_qty\nmagento_2_upload_file_with_data_no_desc[\u2018use_config_min_qty\u2019] = use_config_min_qty\nmagento_2_upload_file_with_data_no_desc[\u2018is_qty_decimal\u2019] = is_qty_decimal\nmagento_2_upload_file_with_data_no_desc[\u2018backorders\u2019] = backorders\nmagento_2_upload_file_with_data_no_desc[\u2018use_config_backorders\u2019] = use_config_backorders\nmagento_2_upload_file_with_data_no_desc[\u2018min_sale_qty\u2019] = min_sale_qty\nmagento_2_upload_file_with_data_no_desc[\u2018use_config_min_sale_qty\u2019] = use_config_min_sale_qty\nmagento_2_upload_file_with_data_no_desc[\u2018max_sale_qty\u2019] = max_sale_qty\nmagento_2_upload_file_with_data_no_desc[\u2018use_config_max_sale_qty\u2019] = use_config_max_sale_qty\nmagento_2_upload_file_with_data_no_desc[\u2018notify_stock_qty\u2019] = notify_stock_qty\nmagento_2_upload_file_with_data_no_desc[\u2018use_config_notify_stock_qty\u2019] = use_config_notify_stock_qty\nmagento_2_upload_file_with_data_no_desc[\u2018manage_stock\u2019] = manage_stock\nmagento_2_upload_file_with_data_no_desc[\u2018use_config_manage_stock\u2019] = use_config_manage_stock\nmagento_2_upload_file_with_data_no_desc[\u2018stock_status_changed_auto\u2019] = stock_status_changed_auto\nmagento_2_upload_file_with_data_no_desc[\u2018use_config_qty_increments\u2019] = use_config_qty_increments\nmagento_2_upload_file_with_data_no_desc[\u2018qty_increments\u2019] = qty_increments\nmagento_2_upload_file_with_data_no_desc[\u2018use_config_enable_qty_inc\u2019] = use_config_enable_qty_inc\nmagento_2_upload_file_with_data_no_desc[\u2018enable_qty_increments\u2019] = enable_qty_increments\nmagento_2_upload_file_with_data_no_desc[\u2018is_decimal_divided\u2019] = is_decimal_divided\nmagento_2_upload_file_with_data_no_desc[\u2018_media_is_disabled\u2019] = _media_is_disabled\nmagento_2_upload_file_with_data_no_desc[\u2018tax_class_id\u2019] = tax_class_id<\/span># In[100]:<\/span>#magento_2_upload_file_with_data_no_desc[\u2018categories\u2019] = magento_1_upload_file_with_data_no_desc[\u2018_category\u2019]<\/span># In[101]:<\/span>magento_2_upload_file_with_data_no_desc[\u2018visibility\u2019] = BC2<\/span># In[102]:<\/span>#magento_1_upload_file_with_data_no_desc.drop( columns = \u201c\u201d, axis=1)\nmagento_2_upload_file_with_data_no_desc.columns<\/span># In[103]:<\/span># drop products with the same sku<\/span># In[104]:<\/span>#magento_1_upload_file_with_data_no_desc.drop([\u2018categories\u2019], inplace=True, axis=1)\n# sorting by first name \n#magento_1_upload_file_with_data_no_desc.sort_values(\u201csku\u201d, inplace = True) \n \n# dropping ALL duplicte values \nmagento_2_upload_file_with_data_no_desc.drop_duplicates(subset =\u201dsku\u201d, \n keep = False, inplace = True)<\/span># In[ ]:<\/span># save the output file i.e. to load to magento 2\n# no image data\/url as part of the upload file<\/span># In[105]:<\/span>#output_folder = \u2018data-china-2020\u201303\u201329\/\u2019\n#output_folder = \u2018.\/data-supplier-2020\u201304\u201314\/output\/\u2019;\nmagento_2_upload_file_with_data_no_desc.to_csv( output_folder + \u2018no-image-all_to_upload_without_description_\u2019 + input_file_name + \u2018_magento_2_\u2019 + today + \u2018.csv\u2019,index=False, encoding=\u2019utf8')<\/span># In[ ]:<\/span># divide the output into multiple files<\/span><\/pre>\n
Medium:\u00a0<\/em><\/strong>https:\/\/medium.com\/@SayedAhmedCanada<\/a><\/p>\n
*** . *** *** . *** . *** . ***<\/p>\n
Sayed Ahmed<\/em><\/strong><\/p>\n
BSc. Eng. in Comp. Sc. & Eng. (BUET)<\/em><\/strong><\/p>\n
MSc. in Comp. Sc. (U of Manitoba, Canada)<\/em><\/strong><\/p>\n
MSc. in Data Science and Analytics (Ryerson University, Canada)<\/em><\/strong><\/p>\n
Linkedin<\/em><\/strong>:\u00a0<\/em>https:\/\/ca.linkedin.com\/in\/sayedjustetc<\/em><\/a><\/p>\n
Blog<\/em><\/strong>:\u00a0<\/em>http:\/\/Bangla.SaLearningSchool.com<\/em><\/a>,\u00a0<\/em>http:\/\/SitesTree.com<\/em><\/a><\/p>\n
Training Courses:\u00a0<\/em><\/strong>http:\/\/Training.SitesTree.com<\/em><\/a><\/p>\n
8112223 Canada Inc\/Justetc<\/em><\/strong>:\u00a0<\/em>http:\/\/JustEtc.net<\/em><\/a><\/p>\n
Facebook Groups\/Forums to discuss (Q & A):<\/em><\/strong><\/p>\n
https:\/\/www.facebook.com\/banglasalearningschool<\/a><\/p>\n
https:\/\/www.facebook.com\/justetcsocial<\/a><\/p>\n
Get access to courses on Big Data, Data Science, AI, Cloud, Linux, System Admin, Web Development and Misc. related. Also, create your own course to sell to others.\u00a0<\/em>http:\/\/sitestree.com\/training\/
\n<\/a><\/p>\n<\/div>\n<\/div>\n<\/section>\n<\/article>\n
\n
\n
\n
\n
\n
\n
Build Ecommerce Software and Systems<\/h2>\n
\n
Build Ecommerce Software and Systems<\/h4>\n<\/div>\n