TransWikia.com

Data scientist vs machine learning engineer

Data Science Asked by Ryan Zotti on December 6, 2020

What are the differences, if any, between a “data scientist” and a “machine learning engineer”?

Over the past year or so “machine learning engineer” has started to show up a lot in job postings. This is particularly noticeable in San Francisco, which is arguably where the term “data scientist” originated. At one point “data scientist” overtook “statistician”, and I’m wondering if the same is now slowly beginning to happen to “data scientist”.

Career advice is listed as off-topic on this site, but I view my question as highly relevant since I’m asking about definitions; I’m not asking about recommendations given my own career trajectory or personal circumstances like other off-topic questions have.

This question is on-topic because it might someday have significant implications for many users of this site. In fact, this stack-exchange site might not exist if the “statistician” vs “data scientist” evolution had not occurred. In that sense, this is a rather pertinent, potentially existential question.

9 Answers

A data scientist’s position these days has become much more generalized and broad-based to the degree that it could fully supersede Machine Learning. And yet, there are cases where a data scientist does not perform data analysis on the data itself.

A data scientist’s roles can be multifarious. Manipulating, processing, and querying large volumes of concurrent data is now an incredibly skilled task in the age of ‘Big Data’ technologies. Thus, a data scientist’s main function may be, for example, to run and manage an architecture to absorb a wide range of data from various sources.

Statistics differ greatly in terms of wages and future growth! But one thing is fore certain that t he number of positions for data scientists well outruns the number of jobs for engineers in machine learning.

And it can be said confidently that these jobs will certainly not go anywhere, at least for the next 20 years, as the amount of data and its complexities will continue to increase significantly more.

Have a look at the following machine learning vs data scientist comparison.

A lot of Data Scientists’ job posting appeared and was flooding the market in the previous years. The same for the Machine Learning Engineer position is happening, it’s a fairly new one and is slowly evolving in areas where we have data specialists. for Checkout this article- Machine Learning Engineer vs Data Scientist

Answered by golden duck on December 6, 2020

Machine Learning is more specific and in the field you will need to master the following:

  • Features vs Labels
  • Test data vs Training data
  • Feature Normalization
  • Common data structures (arrays of arrays)
  • Feature Selection

Answered by Daniel on December 6, 2020

Machine Learning Engineers and engineering focused Data Scientist are the same, but not all Data Scientist are engineering focused. About 5 years ago almost all Data Scientist were engineering focused, e.g, they had to write production code. Now, however, there are many Data Scientist roles that are for most part: playing in Jupyter notebook, understanding data, making pretty graphs, explaining to clients, managers, analysts... They don't do any engineering. And I believe that term Machine Learning Engineers came up to underline that this an engineering position.

Answered by Akavall on December 6, 2020

TL;DR: It depends on who is asking.

The answer to this question depends largely on the expectations, knowledge, and experience of whomever is asking. An analogous question with just as fuzzy of an answer is:

What is the difference between a software developer, a software engineer, and a computer scientist?

To some people, particularly people who study or teach computer science and software engineering, there is a large and defined difference between these fields. But to the average HR worker, technical recruiter, or manager, these are all just "Computer People".

I love this quote by Vincent Granville, emphasis mine:

Earlier in my career (circa 1990) I worked on image remote sensing technology, among other things to identify patterns (or shapes or features, for instance lakes) in satellite images and to perform image segmentation: at that time my research was labeled as computational statistics, but the people doing the exact same thing in the computer science department next door in my home university, called their research artificial intelligence. Today, it would be called data science or artificial intelligence, the sub-domains being signal processing, computer vision or IoT.

Answered by lfalin on December 6, 2020

I don't disagree with any of the answers given. However, I do think that there is a role of Data Scientist that is being glossed over in virtually all of the answers here. Most of these answers say something to the effect of, "Well, an engineer just writes and deploys the model . . . ". Hold on a sec - there's A LOT of work in those two steps!

My core definition of a Data Scientist is someone that applies the scientific method to working with data. So I'm constantly thinking of hypostheses, designing tests, collecting my data and executing those tests, checking my cross validation results, trying new approaches, transforming my data, etc, etc. That's essentially what goes into "just writes and deploys the model" in a professional setting.

So, for your answer, I think "the devil is in the details" because you can't just gloss over some of these steps/terms. Also, if you are job hunting, you should be careful because "data engineer" and "data scientist" can have woefully different pay scales - you do not want to be a data scientist on a data engineer salary!

I always put myself out there as a data scientist, I tell companies that I work on predictive models (not just analytical) and that I'm not an Excel jockey - I write in programming languages (R, Python, etc). If you can find a position that let's you do both of those, then you're on your way to being a data scientist.

Answered by I_Play_With_Data on December 6, 2020

The terms are nebulous because they are new

Being in the middle of a job search in the 'data science' field, I think that there are two things going on here. First, the jobs are new, and there is no set definitions of various terms, so no commonly agreed upon matching of terms with job descriptions. Compare this to 'web developer' or 'back-end developer.' These are two similar jobs that have reasonably well agreed upon and distinct descriptions.

Second, a lot of people doing the job posting and initial interviews don't know that well what they are hiring for. This is particularly true in the case of small to medium sized-companies that hire recruiters to find applicants for them. It is these intermediaries that are posting the job descriptions on CareerBuilder or whatever forum. This isn't to say that many of them don't know their stuff, many of them are quite knowledgeable about the companies they represent and the requirements of the workplace. But, without well defined terms to describe different specific jobs, nebulous job titles are often the result.

There are three general divisions of the field

In my experience, there are three general divisions of the 'job space' of data science.

The first is the development of the mathematical and computational techniques that make data science possible. This covers things like statistical research into new machine learning methods, the implementation of these methods, and the building of computational infrastructure to employ these methods in the real world. This is the division farthest separated from the customer, and the smallest division. Much of this work is done by either academics or researchers at the big companies (Google, Facebook, etc). This is for things like developing Google's TensorFlow, IBM's SPSS neural nets, or whatever the next big graph database is going to be.

The second division is using the underlying tools to create application specific packages to perform whatever data analysis needs to be done. People are hired to use Python or R or whatever to build analysis capability on some set of data. A lot of this work, in my experience, involves doing the 'data laundry,' turning raw data in whatever form into something usable. Another big chunk of this work is databasing; figuring out how to store the data in a way that it can be accessed in whatever timeline you need it in. This job isn't so much taking tools, but using existing database, statistics, and graphical analysis libraries to produce some results.

The third division is producing analysis from the newly organized and accessible data. This is the most customer facing side, depending on your organization. You have to produce analysis that business leaders can use to make decisions. This would be the least technical of the three divisions; many jobs are hybrids between the second and third divisions at this point, since data science is in its infancy. But in the future, I strongly suspect that there will be a more clean division between these two jobs, with people win the second job needing a technical, computer science or statistics based education, and this third job needing only a general education.

In general, all three could describe themselves as 'data scientist', but only the first two could reasonably describe themselves as 'machine learning engineer.'

Conclusion

For the time being, you will have to find out yourself what each job entails. My current job hired me on as an 'analyst,' to do some machine learning stuff. But as we got to work, it became apparent that the company's databasing was inadequate, and now probably 90% of my time is spent working on the databases. My machine learning exposure is now just quickly running stuff through whatever scikit-learn package seems most appropriate, and shooting csv files to the third division analysts to make powerpoint presentations for the customer.

The field is in flux. A lot of organizations are trying to add data science decision making to their processes, but without knowing clearly what that means. Its not their fault, its pretty hard to predict the future, and the ramifications of a new technology are never very clear. Until the field is more established, many jobs themselves will be as nebulous as the terms used to describe them.

Answered by kingledion on December 6, 2020

It may vary from company to company, but Data Scientist as a designation has been around for some time now and is usually meant for extracting knowledge and insights from data.

I have seen data scientists doing

  • Writing Image processing and image recognition algorithms,
  • Design and implement decision trees for a business use case,
  • Or simply design and implement some reports or write ETLs for data transformations.

Data science, however, is a super-domain of machine learning

It employs techniques and theories drawn from many fields within the broad areas of mathematics, statistics, information science, and computer science, in particular from the subdomains of machine learning, classification, cluster analysis, uncertainty quantification, computational science, data mining, databases, and visualization.

Machine learning engineer seems to be a designation where your employer has already narrowed down to the

  • Approach,
  • Tools,
  • and a rough model (of what to deliver)

to extract knowledge or insights from data using machine learning and your work will be to design and implement machine learning algorithms to deliver the same.

Answered by gurvinder372 on December 6, 2020

Good question. Actually there is a lot of confusion on this subject, mainly because both are quite new jobs. But if we focus on the semantics, the real meaning of the jobs become clear.

Beforehand is better to compare apples with apples, talking about a single subject, the Data. Machine Learning and its sub-genre (Deep Learning, etc.) are just one aspect of the Data World, together with the statistic theories, the data acquisition (DAQ), the processing (which can be non-machine learning driven), the interpretation of the results, etc.

So, for my explanation, I will broad the Machine Learning Engineer role to the one of Data Engineer.

Science is about experiment, trials and fails, theory building, phenomenological understanding. Engineering is about work on what science already knows, perfecting it and carry to the "real world".

Think about a proxy: what is the difference between a nuclear scientist and a nuclear engineer?

The nuclear scientist is the one which know the science behind the atom, the interaction between them, the one which wrote the recipe which allow to get energy from the atoms.

The nuclear engineer is the guy charged to take the recipe of the scientist, and carry it to the real world. So it's knowledge about the atomic physics is quite limited, but he also know about materials, buildings, economics, and whatever else useful to build a proper nuclear plant.

Coming back to the Data world, here another example: the guys which developed Convolutional Neural Networks (Yann LeCun) is a Data Scientist, the guy which deploy the model to recognize faces in pictures is a Machine Learning Engineer. The guy responsible of the whole process, from the data acquisition to the registration of the .JPG image, is a Data Engineer.

So, basically, 90% of the Data Scientist today are actually Data Engineers or Machine Learning Engineers, and 90% of the positions opened as Data Scientist actually need Engineers. An easy check: in the interview, you will be asked about how many ML models you deployed in production, not on how many papers on new methods you published.

Instead, when you see announces about "Machine Learning Engineer", that means that the recruiters are well aware of the difference, and they really need someone able to put some model in production.

Answered by Vincenzo Lavorini on December 6, 2020

[Completely a personal opinion]

When the term 'Data Scientist' overtook 'Statistician', it is more towards sounding cool, rather than any major difference. Similarly, the term 'Deep Learning'. It is just neural networks (which is another Machine Learning algorithm) with a couple of more layers. No one can explain when a particular neural net can be called DL, rather than ML, cause the definition itself is fuzzy. So, is the term 'Data Scientist'.

However, as companies are adopting the DevOps mindset to data science, the term ML Engineer evolved.

What is the DevOps mindset to data science?

This is where you build the model, deploy it and also expected to maintain it in production. This helps in avoiding a lot of friction in software teams.

[PS: DevOps is a way of doing software, more like a philosophy. So, using it as a designation, again confuses me].

So, ML engineers are supposed to know the nuances of systems engineering, ML, and stats (obviously).

A vague generalization would be Data Engineer + Data Scientist = ML Engineer.

Having said that, the designations in this space are becoming vague day by day, and the term 'Statistician' is becoming more and more relevant (the irony!).

Answered by Dawny33 on December 6, 2020

Add your own answers!

Ask a Question

Get help from others!

© 2024 TransWikia.com. All rights reserved. Sites we Love: PCI Database, UKBizDB, Menu Kuliner, Sharing RPP