Sep 06

Did you every wonder why your product is not showing up in a category in Magento?

By Sayed in Magento 2, ব্লগ । Blog

Magento 2 Product Visibility Grid

Did you every wonder why your product is not showing up in a category in Magento?

Magento has a complex way of building a product collection. Due to several conditions, indexes, plugins and other complexities determining whether a product should show is not that straightforward."

Details and Tools/Modules:
https://github.com/Itonomy/magento2-product-visibillitygrid

Sep 06

GEO VISUALIZATION: Data Visualization

By Sayed in AI ML DS RL DL NN NLP Data Mining Optimization, Data Visualization, ব্লগ । Blog

GEO VISUALIZATION

spatial data

https://searchsqlserver.techtarget.com/definition/spatial-data

File:Latitude and Longitude of the Earth.svg

https://en.wikipedia.org/wiki/File:Latitude_and_Longitude_of_the_Earth.svg

Geographic coordinate system

https://en.wikipedia.org/wiki/GWhy are all world maps wrong?eographic_coordinate_system

How To Read GPS Coordinates

https://www.ubergizmo.com/how-to/read-gps-coordinates/

Geographic coordinate conversion

https://en.wikipedia.org/wiki/Geographic_coordinate_conversion

GPS coordinates converter

https://www.gps-coordinates.net/gps-coordinates-converter

GPS coordinates converter

https://www.gps-coordinates.net/gps-coordinates-converter

Map Projection

https://en.wikipedia.org/wiki/Map_projection

Why are all world maps wrong?

https://www.quora.com/Why-are-all-world-maps-wrong

Map Projections – types and distortion patterns

http://geokov.com/education/map-projection.aspx

Map Projection

https://en.wikipedia.org/wiki/Map_projection

Map projections and distortion

http://www.geography.hunter.cuny.edu/~jochen/GTECH361/lectures/lecture04/concepts/Map%20coordinate%20systems/Map%20projections%20and%20distortion.htm

Mercator’s Projection

http://www.math.ubc.ca/~israel/m103/mercator/mercator.html?utm_source=weibolife

https://en.wikipedia.org/wiki/Mercator_projection

https://www.britannica.com/science/Mercator-projection

MAPS, CHARTS, AND PROJECTIONS

http://www.tpub.com/timeconversion/15.htm

Understanding Map Projections

https://pdfs.semanticscholar.org/e844/813f5ec9665a9bce66eedd074430ee570471.pdf

Why Are Rhumb Lines (Loxodromes) a Constant Track Direction? (and not the Shortest Path)

https://gisgeography.com/rhumb-lines-loxodromes/

Kartography

http://cxhernandez.com/static/files/kartography/images/svg.png

ShapeFile and Data File

https://en.wikipedia.org/wiki/Shapefile

Geojson

http://geojson.io/#map=2/20.0/0.0

https://en.wikipedia.org/wiki/GeoJSON

Latlong-converter

https://www.directionsmag.com/site/latlong-converter/

Get Latitude and Longitude

https://www.latlong.net/

Sep 06

NETWORK VISUALIZATION : Data Visualization

By Sayed in AI ML DS RL DL NN NLP Data Mining Optimization, Data Visualization, ব্লগ । Blog

NETWORK VISUALIZATION

Example:
http://graphs.grevian.org/resources/static/images/example1.png

Graph
http://mathworld.wolfram.com/Graph.html

DIRECTED, UNDIRECTED, WEIGHTED, UNWEIGHTED GRAPH REPRESENTATION IN ADJACENCY LIST, MATRIX REFERENCE SHEET
https://quickgrid.wordpress.com/2015/05/29/directed-undirected-weighted-unweighted-graph-representation-in-adjacency-list-matrix-reference-sheet/

Graphs in Computer Science
http://web.cecs.pdx.edu/~sheard/course/Cs163/Doc/Graphs.html

Types of Graphs
https://www.javatpoint.com/types-of-graphs

Finite State Machines
https://brilliant.org/wiki/finite-state-machines/

A D3 Network Graph
http://bl.ocks.org/jose187/4733747

Fisheye Distortion
https://bost.ocks.org/mike/fisheye/

http://www.michelecoscia.com/wp-content/uploads/2012/08/demon2.png

Arc Layout
http://bl.ocks.org/sjengle/5431779

Gridlayout
http://opentutorials.cgl.ucsf.edu/images/b/bc/GridLayout.png

Circular Layout
https://66.media.tumblr.com/8162e2b68064b3aff0fcc5f9be90c016/tumblr_inline_mtcb19aG1n1qzro4y.png

An A to Z of extra features for the D3 force layout
http://www.coppelia.io/2014/07/an-a-to-z-of-extra-features-for-the-d3-force-layout/

Force Layout
https://medium.com/@sxywu/understanding-the-force-ef1237017d5#.fo45j7vnp

Understanding D3.js Force Layout – 3: Seeing a Layout in Action
http://jsdatav.is/visuals.html?id=26648f33f3bc9725604a

Force-Directed Graph
https://observablehq.com/@d3/force-directed-graph

Hive Plot (Links)
https://bl.ocks.org/mbostock/2066415

Hive Plots
https://bost.ocks.org/mike/hive/

Exploratory Data Analysis of Network Traffic in Industrial Control Systems
http://docplayer.net/13892735-Exploratory-data-analysis-of-network-traffic-in-industrial-control-systems.html

Graph Theory – Isomorphism
https://www.tutorialspoint.com/graph_theory/graph_theory_isomorphism.htm

Planar graph
https://en.wikipedia.org/wiki/Planar_graph

Chord Dependency Diagram
https://observablehq.com/@d3/chord-dependency-diagram

Hierarchical Edge Bundling
https://observablehq.com/@d3/hierarchical-edge-bundling

Hierarchical Edge Bundles:Visualization of Adjacency Relations in Hierarchical Data
https://aviz.fr/wiki/uploads/Teaching2014/bundles_infovis.pdf

Sep 05

Data Visualization Misc

By Sayed in AI ML DS RL DL NN NLP Data Mining Optimization, Data Visualization, ব্লগ । Blog

Data Visualization Overview:
—————————-

Data Visualization: About Data Visualization
http://guides.library.duke.edu/c.php?g=289678&p=1930713

I Can See Clearly Now: A Survey of Data Visualization Techniques & Practice
https://www.slideshare.net/myles_harrison/i-can-see-clearly-now-a-survey-of-data-visualization-techniques-practice-31179055

Visualization in Data Science: What is it for?
http://guides.library.duke.edu/c.php?g=289678&p=1930713

Anscombe’s quartet

https://en.wikipedia.org/wiki/Anscombe’s_quartet

Storytelling and data visualization… So what?
https://www.dapresy.com/storytelling-and-data-visualization/

Visualization Types

https://guides.library.duke.edu/datavis/vis_types

Junk Charts

https://junkcharts.typepad.com/junk_charts/2012/10/expanding-circles-of-error.html

Visualization Analysis & Design

https://www.cs.ubc.ca/~tmm/talks/minicourse14/vad16nasa.pdf

—
Python Treemaps with Squarify & Matplotlib
Treemaps With Squarify

https://fcpython.com/visualisation/python-treemaps-squarify-matplotlib

—
200 Basic Treemap with python
HIERARCHICAL CLUSTERING IN R: THE ESSENTIALS
Geographic Data with Basemap
Plotting data on a map (Example Gallery)
https://matplotlib.org/basemap/users/examples.html
—
https://gist.github.com/blaylockbk/79658bdde8c1334ab88d3a67c6e57477
Introduction to Interactive Time Series Visualizations with Plotly in Python

Time Series Data Visualization with Python

Introduction to Data Visualization in Python
https://towardsdatascience.com/introduction-to-data-visualization-in-python-89a54c97fbed

https://guides.library.duke.edu/c.php?g=289678&p=1930713

http://cds.nyu.edu/wpcontent/uploads/2014/04/bertini_datascience_showcase_May12_2014.pdf
https://en.wikipedia.org/wiki/Anscombe’s_quartet

DATA VISUALIZATION VS. INFOGRAPHICS

https://visage.co/throwdown-data-visualization-vs-infographics/

—

https://galaxydatatech.com/2018/03/20/treemaps-with-squarify/

https://python-graph-gallery.com/200-basic-treemap-with-python/

—

Dendrograms in Python

https://plot.ly/python/dendrogram/

https://python-graph-gallery.com/dendrogram/

https://www.datanovia.com/en/lessons/examples-of-dendrograms-visualization/

—

https://jakevdp.github.io/PythonDataScienceHandbook/04.13-geographic-data-with-basemap.html

—

A quick demonstration of creating a basemap and plotting or drawing objects

—

https://towardsdatascience.com/introduction-to-interactive-time-series-visualizations-with-plotly-in-python-d3219eb7a7af

—

https://machinelearningmastery.com/time-series-data-visualization-with-python/

—

Sep 05

Data Visualization: BASIC CHARTS : Resources:

By Sayed in Data Visualization, ব্লগ । Blog

BASIC CHARTS

Types: Datasets and Data
http://www.cs.ubc.ca/~tmm/talks/minicourse14/vad16nasa.pdf

Common Charts
Histogram: https://en.wikipedia.org/wiki/Histogram
Histogram Examples: https://statistics.laerd.com/statisticalguides/understanding-histograms.php

The problem with Sturges’ rule for constructing histograms
https://robjhyndman.com/papers/sturges.pdf

Bad examples for Histogram: https://www2.southeastern.edu/Academics/Faculty/dgurney/Math241/StatTopics/HistGen.htm

Histogram (Non-Uniform Widths)
https://www.onlinemathlearning.com/histogram-width.html

What Is a Frequency Polygon Used For?
https://www.reference.com/math/frequency-polygon-used-54f72d4d24e0666c

Histograms and histographs
https://www150.statcan.gc.ca/n1/edu/power-pouvoir/ch9/histo/5214822-eng.htm

Frequency Polygon
http://www.matematikaria.com/kamus/frequency-polygon.html

—

Bar Chart

Chart
https://en.wikipedia.org/wiki/Chart#/media/File:F%C3%B6rs%C3%A4ljningsstatisti%20k_f%C3%B6r_blanddrycker.png

https://en.wikipedia.org/wiki/Chart

Bar Chart: Construction
https://www.slideshare.net/infinityrulz/stats-16

Survey:
https://www.slideshare.net/myles_harrison/i-can-see-clearly-now-a-survey-of-data-visualization-techniques-practice-31179055
https://www.slideshare.net/infinityrulz/stats-16

Piechart
https://en.wikipedia.org/wiki/File:ActionnariatLibe2007-fr.svg

http://fluidsurveys.com/university/use-different-chart-types/

Construction of Pie Charts
https://www.math-only-math.com/construction-of-pie-chart.html

Serviceability Reports Archive
https://www.cisco.com/en/US/docs/voice_ip_comm/cucm/service/4_0_1/ccmsrvs/sssrvrep.html

Understanding Pie Charts: Good and bad Examples
https://eagereyes.org/techniques/pie-charts

Box Plot
https://en.wikipedia.org/wiki/Box_plot

How to Read and Use a Box-and-Whisker Plot
https://flowingdata.com/2008/02/15/how-to-read-and-use-a-box-and-whisker-plot/

Boxplot
http://shiny.chemgrid.org/boxplotr/

How to Think Outside the Boxplot
https://blog.minitab.com/blog/statistics-and-quality-data-analysis/how-to-think-outside-the-boxplot

Sep 04

Data Visualization in Python (R)

By Sayed in AI ML DS RL DL NN NLP Data Mining Optimization, Data Visualization, ব্লগ । Blog

Python Treemaps with Squarify & Matplotlib

https://fcpython.com/visualisation/python-treemaps-squarify-matplotlib

—

Treemaps With Squarify

https://galaxydatatech.com/2018/03/20/treemaps-with-squarify/

—
200 Basic Treemap with python

https://python-graph-gallery.com/200-basic-treemap-with-python/

—

Dendrograms in Python

https://plot.ly/python/dendrogram/

https://python-graph-gallery.com/dendrogram/

—

HIERARCHICAL CLUSTERING IN R: THE ESSENTIALS

https://www.datanovia.com/en/lessons/examples-of-dendrograms-visualization/

—

Geographic Data with Basemap

https://jakevdp.github.io/PythonDataScienceHandbook/04.13-geographic-data-with-basemap.html

—

Plotting data on a map (Example Gallery)¶

https://matplotlib.org/basemap/users/examples.html

—

A quick demonstration of creating a basemap and plotting or drawing objects

https://gist.github.com/blaylockbk/79658bdde8c1334ab88d3a67c6e57477

—

Introduction to Interactive Time Series Visualizations with Plotly in Python

https://towardsdatascience.com/introduction-to-interactive-time-series-visualizations-with-plotly-in-python-d3219eb7a7af

—

Time Series Data Visualization with Python

https://machinelearningmastery.com/time-series-data-visualization-with-python/

—

Introduction to Data Visualization in Python

https://towardsdatascience.com/introduction-to-data-visualization-in-python-89a54c97fbed

Aug 30

Getting Product Data AliExpress

By Sayed in ব্লগ । Blog

Stumbled upon: Getting Product Data AliExpress. Just the technical part. Whether it is ok to do or not, did not check on that.

Scraping product details from AliExpress website

https://www.webharvy.com/articles/scraping-aliexpress.html

—

A beginner’s guide to Aliexpress data scraping and mining

http://blog.hanxiaogang.com/2017-07-29-aliexpress/

—
Oberlo is there for Shopify data integration

Aug 29

Administering Magento 2

By Sayed in Magento 2, ব্লগ । Blog

Magento 2 file/folder permissions setting

https://magehit.com/blog/magento-2-file-folder-permissions-setting/

Magento 2: Run Unit Tests

https://devdocs.magento.com/guides/v2.3/config-guide/cli/config-cli-subcommands-test.html

Install M2E PRO via Magento Marketplace

https://docs.m2epro.com/display/InstallationUpgradeMagento2/via+Magento+Marketplace

M2E Pro – installation options

https://docs.m2epro.com/display/InstallationUpgradeMagento2/Home

Magento 2: Cron Configuration

https://firebearstudio.com/blog/magento-2-cron-configuration.html

Aug 19

Upgrade magento from 2.3.1 to 2.3.2

By Sayed in Magento 2, ব্লগ । Blog

Upgrade Magento from 2.3.1 to 2.3.2

From 2.3.0 to 2.3.2 should also work; from some other earlier versions may or may not work..

A very similar approach worked for me (Note: I have no interest to work in the industry with Magento). Also, after upgrade, check the error log and/or system log files. if you see any issues there fix those. You most probably have to compile as well. Also, you have to adjust write permissions for generated folder and var/cache folder if not done already. compiling just after setup:upgrade or after :deploy : both should work.

sudo chmod +x bin/magento

sudo php bin/magento maintenance:enable sudo composer require magento/product-community-edition 2.3.2 --no-update sudo composer update sudo rm -rf var/cache/ sudo rm -rf generated/ sudo chmod +x bin/magento sudo php bin/magento setup:upgrade sudo php bin/magento setup:static-content:deploy -f sudo php bin/magento indexer:reindex sudo php bin/magento maintenance:disable

Compile command is similar to:

sudo php bin/magento setup:di:compile

Reference: https://magento.stackexchange.com/questions/282452/upgrade-magento-2-3-1-to-2-3-2

Aug 17