Job Data Analysis Reveals top Skills Required for Data Science Role

data-science-dilbert

By: Preetish Panda May 5, 2018

Data scientists help companies make solid data-backed decisions. It’s also a relatively new career, residing at the intersection of social science, statistics, computer science and design fields. This job also happens to be the fastest growing job in the United States, according to LinkedIn. Data science job role has witnessed a growth of 6.5 times from 2012 and there are more than 6,000 data scientists jobs currently listed on LinkedIn. Apart from that Data Science job role also commands lucrative median salary of $113,000 among other fast-growing career paths.

While the job market continues to grow, the demand for data scientists directly results from the shortage of workers. As per a report by McKinsey, we might soon see a shortage of up to 250,000 data scientists. Hence, it would be very interesting to look at the type of skills that someone needs to master in order to become a data scientist.

Since JobsPikr extracts job data from some of the popular job boards, we selected the job listings posted in March, 2018 on Dice.com. The next step involved segregating the job ads with job title as “Data Scientist”. Finally we got a data set of close to 8,000 job listings for data scientists in the US region.

In order to analyze the skills required for this role, we found out the terms present in the “job requirement” section of the job ad. Here is a sample job ad for better perspective:

Data-scientist

Then, we moved to the count of terms of various skills and calculated the percentage of occurrence of these skills in the total number of job listings. Given below is the chart that shows the key skills found in the job ads for data scientists.

Key-skills-for-data-scientists

Let’s now go through these skills individually:

Python

Python has amassed a lot of interest recently as a choice of language for data scientists. Here the factors that make it popular in the data science field:

  • Open Source – a free to install programming language
  • Rich community
  • Lower learning curve
  • Powerful libraries for data analytics
  • Easier integration with databases

For example, scikit-learn is used for machine learning algorithms, PyBrain for building Neural Networks, matplotlib for plotting and iPython notebooks to present the analyses.

SQL

Structured Query Language (SQL) is essential for data scientists as it is the standard language to communicate with relational database management systems (RDBMS). As a data scientist one has to write both simple and complex queries to select data from tables apart from understanding of different data formats for data management and filtering.

R

R is a powerful language developed in the early 90’s; currently it is used widely for data science, analysis and statistical computing. Its popularity can be largely attributed to the following:

  • Wide range of libraries
  • Strong online community
  • Open source
  • Lower learning curve

Java

Since Java is a very old programming language and popular among data scientists in the operational analytics space. It is quite evident that many enterprises already have systems developed with this language. Hence, the models are written in Java as it will be easier to integrate. Apart from that leading Big Data frameworks/tools like Spark, Hive, and Hadoop are written in Java. It is also a great choice when it comes to scalability and speed.

Hadoop

As a framework Hadoop has gained massive popularity and has become the de facto open source software for reliable, scalable, distributed computing involving big data analytics.

SAS

This tool is a leader in the commercial analytics space. It has a huge set of in-built statistical functions, good UI (Enterprise Guide & Miner) for any user to quickly learn and delivers superior technical support. However, it is expensive and its certification programs can also cost a lot.

Spark

Apache Spark is open source and it has the ability to keep data resident in memory, which can lead to faster iterative machine learning workloads. In addition to this, what makes it adoption stronger in data science community is its base on Scala and in-built machine-learning library, MLlib.

C

Similar to Java, C/C++ is also used write models and it is critical for writing the algorithmic extensions for R and Python.

Scala

Any data scientist looking to work on large data sets in a JVM-centric stack will be using Scala. Many of the high performance data science frameworks are written using Scala owing to its amazing concurrency support.

NoSQL

Unlike SQL, NoSQL offers an architectural approach with lesser constraints. In general, it is easier to break down NoSQL data stores, but more complicated to query them for complex results.

For data scientists, NoSQL can be somewhat tricky — although the technology makes it absolutely easy to rapidly accumulate massive data sets and rapidly scale data stores to meet demand, it requires de-normalization of data.

Tableau

VizQL (Visual Query Language) is Tableau’s database visualization language which queries relational databases, cubes, cloud databases, and spreadsheets, and then generates wide range of graphs and chart. These graphs can be combined into dashboards and shared via web. This application is particular useful for data exploration and interactive analysis.

MATLAB

Although MATLAB is not as popular as R or Python in the data science space, it still has a lot of traction in the academia. Also, it is a commercial app with high cost and good customer support.

Hive

This is a popular data warehouse software in the Hadoop ecosystem that helps data scientists in data transformation and analysis. It provides an SQL-like interface to query data stored in various databases and file systems that integrate with Hadoop.

Excel

Microsoft Excel can be considered as a bridge application for very quick filtering and data analysis using in-built statistical methods. However, it becomes powerful when combined with Visual Basic. Check out the examples for building your own Excel-based neural network and Monte Carlo simulations.

Cassandra

Apache Cassandra is an open source distributed NoSQL database management system designed to handle large amounts of data across many commodity servers. As this database was developed for Facebook, where millions of reads and writes happen at each given second, its performance is far superior.

MapReduce

It is a programming model that allows for massive scalability across hundreds or thousands of servers in a Hadoop cluster. Simply going by the name, MapReduce consists of two steps: Mapping and Reducing the data:

  • Mapping sorts and filters a data set
  • Reducing it allows a certain calculation on the resulting information

TensorFlow

This is the open source framework developed by Google Brain Team for machine learning and deep neural networks research. Definitely aspiring data scientists looking to work on neural networks must give preference this framework.

Pig

It is a high level scripting language used for operating on large data sets inside Hadoop. It primarily used to apply schema and transform data.

Conclusion

This sums up the overview of the important skills a data scientist must acquire for better opportunities in career. If you would add any other skill or the reason behind learning a particular skill, do share with us via comments.

Leave a Reply

Your email address will not be published. Required fields are marked *