Featured

WEB TECHIES MUST FOCUS ON THESE WEB TECHNOLOGIES IN ’20

Web applications and their development is a pack of rules and guidelines that developers should obey every-time. If we were imagining a perfectly working website for our own, you need to get used to these Web technologies that will stand by your side to produce an output.

During the process of developing an app or website actually means you are knowing 3 important languages: JavaScript, CSS (Cascading Style Sheets), HTML (Hyper Text Markup Language).

Web Technology means:

You have been keep listening that a developer says about “web development technologies” but have you ever think, what this actually means?

Because of the reason, computers cannot communicate with others as we do, it needs system understandable code. Web Technologies are Markup languages that computers use to communicate.

1. Gateways:

When an website is ready to deploy, we need interpreters for the code we written to produce an output that we desired for, they are called as Gateways. here are some:

Chrome – Gateway produced by Google

Firefox – Mozilla’s Open source Gateway

Safari – Apple Gateway

Internet Explorer – Gateway from Microsoft

there are many more gateways produced by different organisations.

2. HTML & CSS:

HTML was the basic you will learn at the school level. If you got to know how HTML works, you need to know about CSS

CSS describes about the elements of HTML are displayed on gadget screen when you browse through a website. you can produce many page transitions, image effects, text effects, hover effects, shadows for texts and more.

3. Frameworks:

Frameworks are the key points that can make developer use them to avoid doing many tasks in a structured way instead get right to work.

Angular

Angular is one of the latest web technologies designed specifically for developing dynamic web applications. With this framework, you can easily create front-end based applications without needing to use other frameworks or plugins.

The features include templates, MVC (Design pattern) architecture, code generation, code splitting etc. All the expressions are like code snippets that enclosed within curly braces and do not use any loops or conditional statements.

Ruby On Rails:

Ruby on Rails is a server-side website technology that makes app development much easier and faster. The thing that really sets this framework apart is the re-usability of the code.

websites like GitHub, Twitter, Shopify built using Ruby.

Meteor JS:

Meteor JS is written in Node.js and it makes it possible for you to create real-time web applications for different platforms. The framework for creating simple websites for personal use really stands out with Meteor JS.

This is an open-source JavaScript web framework which also means that the webpage loading time is significantly shorter. JavaScript stack also makes it possible to get the same results with fewer lines of code than usual results.

Expres JS:

Developed in Node.js, Express.js is a web app development network that is great for those who need to develop apps and APIs as fast as possible. A lot of great features are provided with the help of plugins.

Django:

Django is one of the most popular frameworks written in Python and follows MVC architecture. It makes the app development process much easier thanks to its simplicity.

Django simplifies using Python a lot and provides multiple tools that make a web app developer’s life easier – e.g. an ORM, Models, Django admin, templates, etc

4. Languages:

As i spoke before that computers cannot understand human languages, hence they need a coding language, here are some programming languages:

Javascript – used by all web browsers, Meteor, and lots of other frameworks

CoffeeScript – a “dialect” of JavaScript. It is viewed as simpler but it converts back into JavaScript

Python – used by the Django framework as well as in the majority of mathematical calculations

Ruby – used by the Ruby on Rails framework

PHP – used by WordPress to create editors, It’s also used by Facebook, Wikipedia, and other major sites

Go – newer language, built for speed

Swift – Apple’s newest programming language

Java – used by Android and a lot of desktop applications.

5. Requests:

The instructions for how to pass information between computers and gadgets are known as protocols.

HTTP

This protocol, each website can get to the browser. The protocol requests the website from Google server and then receives a response with the HTML, CSS, and JavaScript of the website.

DDP

Uses websockets to create a stable connection between the client and the server. As a result of that, you are getting website updates in real-time without having to refresh the browser.

REST

Useful for API’s, this protocol has standard methods like GET, POST, and PUT that let information be exchanged between applications.

6. APIs:

APIs are well known to allow others to use some of the features without actually sharing codes. Well known examples for APIs are Facebook, Twitter, Gmail for their Login though services.

7. Data formats:

Data is stored in the structure called a data format.

JSON – JavaScript Object Notation is a syntax for storing and exchanging data (just like XML).

XML – Predominantly used by Microsoft systems, it used to be the most popular data format

CSV – is data formatted by commas; for example Excel data.

8. Client-side:

Users of an application is called a client. Clients can be computers, mobile gadgets, tablets etc. Usually, multiple clients are interacting with the same app stored on a server at a singular point of time.

9. Server-side:

The application code is usually stored on the server. The clients who are using the application make requests to the servers. The servers then respond to those requests after gathering the requested information.

Author: Mihir Bommisetty

Featured

The Tower which almost unknown to many

An Invention, what happened? why it got demolished? what all the reasons that a great invention lead to demolish? did any antagonists imposed any Fake news?……. The solutions for all the ‘WH’ questions this article will be answering right here.

Nikola Tesla stepped into 20^thcentury, at the last stage of his scientific life. He wanted to realize that of all his inventions, Nikola Tower commonly known as Wardenclyffee tower, Global communication system. He got permission for his project in 1901, but later this project went side track which lead the scientific and economic downfall of the venture.

Tesla determined to bring life to his dream, Wireless telecommunication system. In the year 1900, the stylish sought financing from J.P Morgan during 1901. He decided to invest $150,000 for the construction of Wardenclyffe Tower.

Morgan was very much impressed by the achievements of G Macroni, who was the rival in this technology race, but Tesla succeeded in pulling him into this project. Tesla Added “we can able to call anyone from the desk we are sitting through out the globe”, which makes everyone convince.

Tesla’s Vision

He was very clear and he imagined the information society in which we currently living. A small invention which can be keep in pocket that can make us to listen to any music, here anywhere, listen to any political speech irrespective of how much of distant we are, along with this we can share and receive images, drawings from such a plant of this kind.

With the help of Morgan’s investment, Tesla bought the 200 acre land on Island near New York,large generators and electrical transformers from Westinghouse Electric company and he hired the architect Stanford White, they both together came up building 187 feet wooden tower with a hemispherical metal dome 68 feet in diameter, along with this a house for research laboratories and other functionalities of the the tower to be taken has built.

The Tower was to begin in august, but Tesla had already changed his idealizations as Marconi was already succeeded in managing to transmit radio signals between France and England. In June Marconi published some details of his transmission technology in magazine ELECTRICAL REVIEW, this publication mentioned about the Tesla coils connected to ground which lead Tesla lost in thoughts that Marconi was copying his idea.

Theory without Evidence

In 1899, during his inventions he succeeded to wirelessly light bulbs where he had powered up a large “TESLA COIL”. He believed that he achieved the terrestrial resonance he wants which he thought can work for any distance. Which makes him enough to prove his ideas and gain upper hand over Marconi. Later, Tesla came up with proposal to Morgan that not only sending messages across globe but he would transmit electricity to any distance without cables.

To achieve this, he felt that would need a tower almost double the height (300 feet) and, of course, much more money. Morgan refused to increase the investment and Tesla had to start the construction of the Wardenclyffe Tower in September 1901, sticking to the original plan. Two months later, the project received another blow that Marconi had managed to transmit the letter “S” in Morse code across the ocean, from England to Canada. In that era of financial uncertainty, investors preferred to bet on the Marconi system, which, having been less ambitious, had achieved historic success.

Tesla never gave up. He finished the Wardenclyffe Tower in 1902 and carried out experiments there until 1905, without managing to launch his beloved telecommunications station, the first of a great worldwide network. That year his alternating current patents got expired where this was the remaining source of funding. Tesla made a second mortgage of Wardenclyffe tower, to cover his debts at the Waldorf Astoria Hotel, which reached but he still had to abandon the project, which the press was beginning to label a “hoax”. After years of neglect and deterioration, Tesla lost ownership in 1915 as he was unable to repay the mortgages. The Wardenclyffe Tower was demolished in 1917 and the main building ended up being a factory.

In 2013, a successful campaign was launched by the creator of the web comic The Oatmeal to repurchase the property and to construct on the site the Tesla Science Museum, in honour of a great inventor who, after the failure of Wardenclyffe, never made any of his revolutionary ideas come true again.

Note: The above information is gathered from the Internet sources and all the research i’ve done till date on Wireless Electricity and Wardenclyffe Tower.

Author: Mihir Bommisetty

Featured

BEING SAFE DURING QUARANTINE

As Covid 19 lead us towards a total Online World, Cyber security is the one part that we should bother about.

A large stack of Information, the internet is a key point that can be used to inspire, aid and learn. This pandemic reminds me the saying: Not all we were seeing is the real and not all we hearing is the True. While information is frequently changing day by day, it will be a tough task to us to figure out what’s the true and false along with are we secured or not. putting that in mind, here are some thoughts that can keep us informed and safe online.

High consciousness while spreading news they may be Rumors

There is huge stack of information that was unknown on the planet, it is the first quality of people to be the first “knowing this”. Even if a false or incorrect information is put on social media, humans believe and without knowing the information or facts regarding the claim on Media, humans spreads it.

This results to circulate root less information and panic people, one of the crazy Rumor i came across recently was “5G cell phone technology is the cause for COVID-19”.

Looking at Scams not to happen

There will be many people who will be looking to take advantage of others who are on the line of wound we commonly say injury. Internet criminals will be looking at Servers of companies and their employees. Phishing emails, online scams have increased during this COVID-19.

Some of the scams like they send e-mails where if we click links or clicking on images will download the vulnerable softwares and tracking all the information in our computer, Laptop, Ipad. Mainly these softwares will steal personal data like passwords, credit and debit cards pins.

Maintain Distance with Fakeness

We have been seeing that many companies claims that their products can track people affected with COVID-19 and can even cure. By seeing this we can easily find it out that this News is fake because, according to Center for Disease Control and Prevention currently there are no vaccines that can prevent and there was no medication / food that was approved to treat COVID-19. National Cyber Workers will keep an eye on all those who are working on these Fake claims and will take legal action against them. If in case if you came across any fake news or false claim or being an victim to these vulnerabilities contact the FBI Internet Crime Complaint Center.

It is very Important to make a point that this article is not having all the inclusive stack type of scams. Be conscious of any strange voice calls, huge text messages and false requests for donations especially during Lockdown. It is very important that washing hands, maintaining social distancing, taking care of online safety and vigilance about our internet should be a main priority.

Author: Mihir Bommisetty

Featured

Step by Step website Building – Hosting guide

If you’re one of those readers: I’m glad. But today, hopefully, I can make it up to you. I realize you are interested to grow your career as a website builder, or do understand web design easily.

The most common question I get from beginner readers is along the lines of: “how do I get a website up and running so that I can start growing my electronic society?”

of course it’s a great question. and, it’s one that deserves an answer.

Today, I’m going to go through the process of building a website up and running from zero level. I’ve given it down into clear steps and I think have tried to make things as clear as possible, everything from a website builder, perhaps using a website template to web design.

Ready? Let’s go…

Why we shouldn’t use third-party sites to develop?

Everyone might have seen advertisements for website builders, especially website templates, that let us “create a website by clicking a button build!!”.

websites like:

Blogger
WordPress
Tumblr
TypePad
Wix etc..

Most of these offer both free and paid plans on the basis on how complex we want our web design, if we need web hosting and how much traffic we need the web server to maintain traffic-wise.

I understand why these website templates would be that much tempting to the novice website developers, but we should really avoid them.

If you’re just hoping around and blogging as a hobby, no problem, we can use a website template.

But, if we’re trying to build a business website, we’re stepping intentionally towards fail.

My suggestion: don’t do it!

Here are some reasons, why we need to avoid them?

Reason #1 – It costs money as per our requisites.

Reason #2 – It’s ideas are limited.

Reason #3 – It’s not much easier to understand.

Step 1: Our website needs a place to live we call it as web hosting:

The first part of a website that we need to bother is hosting.

Think of your website as a collection and large package of files. When it got finally “hosted” on your computer, only you can open it up.

When you host those files on a web server, anyone can connect to that server through the internet.

Hosting companies offer space on these servers, or even on your own dedicated web server if you’re willing to pay for it. I would prefer your own dedicated servers for security, privacy and healthy reasons.

You purchase a hosting package from a hosting provider, and they will let you upload your website files. Once you connect that domain name (will discuss about domain name in step 2 don’t skip!!), anyone can view your website.

There are a few factors that we need to look in web hosting regularly:

Hosting factor #1 – Uptime reliability:

If your hosting isn’t operating as it should be, no one can access your website from any web server. This is just as bad as not having a website in the first place.

Hosting factor #2 – Customer service: Things will surely go wrong. that is fact. If you’re a beginner with websites, you’re going to mess things up, once in a while.

Usually, things are easy to fix, at least to an expert. so we need to look for the hosting platform where there can be a best customer service.

Hosting factor #3 – Speed is king: While I’m not going to deep into the fine details right now because they aren’t that important before you have your site up and running, site speed is extremely important.

Step 2: The perfect name: It’s time to create some eye-catchy domains for putting some thought into what your website will be about just for clicking that domain name.

If you already have an idea in mind, this will be easy.

Option #1 – Brute force method: If you’re a creative person, you can try your hand for coming up with a great domain name, from the top of your head.

Option #2 – Use a tool: If you need a little gist in creativity in getting a domain, there are some great free domain name generators at your disposal.

They work slightly different from each other, but the process is generally the same.

Step 3: Make building and editing your website easy with a CMS:

CMS stands for content management system.

Remember that you have to store all your website’s files collection / package on your hosting server. If you really wanted to, you could edit these files every time you wanted to make a change to your website.

Obviously, that’s kind of a pain to do.

A CMS lets you edit your website from the domain itself. You can log in to the domain and then customize your layout, settings and content, as well as create new posts and pages, often using website templates that are easy to use.

I can say in other words: It makes creating and updating a website much easier and saves you a lot of time.

There’s no perfect CMS. There are hundreds out there, some better than others. In general, though, all of the top ones have different strengths and weaknesses.

I’m going under the assumption that you’re just trying to get a basic website or blog up and running. If your response is yes, stick to one of the popular CMSs that I’m about to outline. It will make your work a lot easier.

If you’re trying to create a custom web application, you’re going to need a custom solution.

Option #1 – WordPress

Option #2 – Joomla

Option #3 – Drupal

Option #4 – Rainmaker

Option #5 – GoDaddy

Step 4: How to edit your website without messing everything up:

I remember being a complete beginner to all things internet and being scared that I would break a website. While it’s not likely to happen if you’re careful, it happen as i experienced even i have done with utmost care.

One of the most important ways to protect your website is by using a child theme. A child theme is typically a style sheet that is kept separate from the rest of your theme files on the webserver that you are using.

You can input CSS (cascading style sheets) into a child theme to customize the look of your website.

There are 2 reasons you do this:

It’s hard to break your site
It protects you from updates

Step 5: Connect your domain name to your web host:

If you have chosen a registrar that is different from your web hosting service you’ll need to connect your domain name with your web host. In order to connect your domain name with your web host all you have to do is ask your web host for your server name or DNS (Domain Name Service) and plug your DNS into your domain name registrar account.

You can also contact your domain name registrar and have them guide you through it as it can be a bit confusing for the first time around.

Step 6: After you are done with a functioning website, what to do next ?:

This step is about after getting a fully working website we need to get more audience and we need to promote our business by following simple sub-steps mentioned below:

Sub-step # 6.1 – Get a logo

Sub-step # 6.2 – Write basic copy

Sub-step # 6.3 – Install analytics and look into it frequently

Sub-step # 6.4 – Plan your marketing strategy for the effective use of your website

Conclusion:

Before you get started with the six steps to creating your first website, I need to tell you one more thing: Be patient.

Everyone struggles while building their first website even me more than you all. You will get better, the more that you practice.

If you’re getting frustrated with something, take a deep breathe, relax for a some time, then search a solution for your problem.

Still if you didn’t get a solution drop a mail at blogsofmihir@gmail.com or drop a comment below……

Author : Mihir Bommisetty

Featured

Build Your 1st Python Web Application With Flask

Why Python?

Python, the most favorite language among beginners, is known for its simplicity and its clean and concise way of implementing things. Despite the hype around machine learning, Python has done enough to conquer the web application domain as well.

It is one of the most preferred languages to build backend applications. Even when facing good old PHP and full stack Javascript, Python has its place because of the ease of implementation that keeps beginners hooked.

Why Flask?

Just like how we get confused with which Python version to use, Django vs Flask is another debate. Though statistics say Flask is simple and easy to get started with while Django is heavy for building web applications, there is another important reason why you should we look for Flask over Django.

We, as developers in the era of the cloud, are moving away from single-tiered software applications. With microservices architecture in place, running multiple Django servers is going to make your services heavy because of all the built-in apps it packs with.

Software with Setup:

Python – 3.7
Pycharm IDE
create a project ( todolist-flask)
virtualenv
Install flask with the command pip install flask

Let’s build the application

Operations we expect to add in application:

Create an item
Delete an item
Mark an item done
Update an item

These are low level functionalities, but we can go with features like

Categorizing ToDo items into workplace, personal etc;
Tagging items
Prioritizing items
Remainder

Data Look

Create an Item – Title, Short Description, CreateOn, DueOn
Delete an Item – _is_deleted
Mark an Item Done – _is_done
Update an Item – We are not editing any other info other than one we created, so no additional parameters required.

Schema Design:

For database, we are using SQLite relational db where it senses we store data in tables. we need a table with columns.

ToDo_Works
Id                   Primary Key
Title                Text
Description          Text
CreateOn             Date
DueOn                Date
_is_deleted          Boolean
_is_done             Boolean

This looks good to complete if we are designing a system for only one person, but we are not. We are going to implement this large number of people which requires lots of users data needs to be stored that are signed in into the system and maintain a reference to the user with each ToDo Work in ToDo_Works table.

User
   Name             Text
   Email            Email
   Id               Primary Key

ToDo_Works
   ...
   ...
   CreatedBy        Foreign Key(User)

Now, for our Application, we are going to differentiate the code into 3 files

app.py – the entry and exit point
service.py – request to response conversion
models.py – everything that needs a database handling

Why we need 3 different files?

By differentiating the app into 3 different files we are separating the business logic(service.py), the application layer(app.py) and the data(models.py). In technical terms, this is called an MVC — Model View Controller Pattern.

# 1.import sqlite
import sqlite
# 2. create a connection to DB     
conn = sqlite3.connect('todo.db')
# 3. Write your sql query   
query = "<SQLite Query goes here>"
# 4. execute the query
result = conn.execute(query)

Throughout the models.py file you see this pattern repeating for creating, deleting, updating items in our Todo list.

Creating tables

Creating Tables

Let’s keep aside Flask for now and look at the Pythonic way of creating these tables. To handle all the DB related operations we are going to create a separate file called models.py

It consists of two parts

Schema — Where are the DB Tables are created and maintained.

class Schema:
    def __init__(self):
        self.conn = sqlite3.connect('todo.db')
        self.create_user_table()
        self.create_to_do_table()
        # Why are we calling user table before to_do table
        # what happens if we swap them?

    def create_to_do_table(self):

        query = """
        CREATE TABLE IF NOT EXISTS "Todo" (
          id INTEGER PRIMARY KEY,
          Title TEXT,
          Description TEXT,
          _is_done boolean,
          _is_deleted boolean,
          CreatedOn Date DEFAULT CURRENT_DATE,
          DueDate Date,
          UserId INTEGER FOREIGNKEY REFERENCES User(_id)
        );
        """

        self.conn.execute(query)
    def create_user_table(self):
        # create user table in similar fashion
        # come on give it a try it's okay if you make mistakes
        pass

2. Todo — Operations related to ToDo table

You can think of models as a binding that associates DB tables with associated functions. Hence we create a class with 4 methods Create, update, delete and list which correspond to 4 common SQL queries CREATE, UPDATE, DELETE and SELECT

class ToDoModel:
    TABLENAME = "TODO"

    def __init__(self):
        self.conn = sqlite3.connect('todo.db')

    def create(self, text, description):
        query = f'insert into {TABLENAME} ' \
                f'(Title, Description) ' \
                f'values ("{text}","{description}")'
        
        result = self.conn.execute(query)
        return result
   # Similarly add functions to select, delete and update todo

I wrote only create function similarly add select function, delete function and update function to the file when you are developing the application.

The View Functions

The view functions as I already mentioned is the entry and exit point of the system. The kind of decisions that we take in this file include

Type of input we expect from the user — JSON, File, free text etc.,
Type of output we are providing the user — JSON, file, HTML page etc.,
Authentication of the requests
Logging the requests

# app.py

@app.route("/todo", method=["POST"])
def create_todo():
    return ToDoService().create(request.get_json())

Finally

Now we have all our functions in place talking to each other. All we got to do is hit the API endpoint, create some ToDo Items and see it all working in action.

Throughout this blog, I have never talked about how are we going to build an interface for people to enter the Todo items and where they mark them done etc., As I said, in the beginning, we are learning not just Flask but also the practices followed in the industry.

Most of the software out there works with completely separated backend and frontend. What we have created is a backend system.

To see it working we can build a front-end, which we will do with React in the next blog. But for now, I am going to show you how you can consume it with Python.

Let your app.py be running in one console. Now as you see it is running in my localhost at port 5000.

2. Let’s create our first todo. Open another terminal. I use request python package to consume APIs with Python.

pip install requests

3. Open python shell and hit the API

$ python
>>> import requests
>>> requests.post("http://localhost:5000/todo", 
                  json={"Title":"my first todo", 
                        "Description":"my first todo"})
<Response [200]>

requests.post calls the post API we just created with the data required to create a ToDo Item. We get a response 200 which means it is successfully created.

I have run the code 4 times and on hitting the /todo API with GET method I get the following response.

If you have come this far into the blog give yourself a pat on the back because guess what? You’re awesome!!. This is just the starting point.

Total Running Repository is uploaded on GitHub.

Author: Mihir Bommisetty

follow on Instagram: mi.hi_r

Featured

5 Web Developing needs you need to know about in Twenty’20

Needs are essential part of web development. It looks like there is nothing other than zippy files with the changing moods of customer. However, important streams have an effect on every detail of user interface – from the amount of white-space between content – headline they need to the coloring. irrespective of your taste they we can’t live in a vacuum!!!

Therefore, keeping up things in mind that rule the traffic incoming on the web is truly essential.

2019 has bought us many trends that have shaped designs for websites. The most popular, refreshing and inspiring have been mouse trails, blobs, cyberpunk aesthetics, brutalist designs, retro vibes and futuristic concepts. Although the year is over chances are that same that people are looking forward with the developers who are web – developing using these trends in 2020.

Websites Targeting Millennials
Color of the Year
Animation Everywhere
Cyberpunk, Futuristic, High-Tech Elements
Artistic Website Designs

Conclusion

Always drive towards the trend rather struggling find the way against the people.

Even though trends come and go, you still not allowed to ignore them completely. If you want to tell to your audience, you know how to handle the changes right. Remember, trends are your friends. They tell you exactly what you need to do to adjust your website to make it look excellent.

Trends are always friends
~ Mihir Bommisetty

All the trends will be explained in the next publishing……….

To be Continued……

Author : Mihir Bommisetty

COVID-19 IMPACT: The Love BUG in the times of The Deadly VIRUS

With Social distancing norms, self-isolations, national wide lockdowns in place to place, this gave space for the online dating apps which had suddenly adopted the change in human lifestyles. As a result, most app makers have introduced ‘Digital Date’. Haha Yeah!! A digital date which no one could imagine till now. ill this covid induced lives mending the purely online dating situation results in any behavioral changes in humans?

Tinder is now came up and testing a new feature of video dating to tackle the decreasing user growth of their app. While Bumble had already launched a video cum voice call feature previous year, Hinge has came up with ‘Date from Home’ feature in the month of March. This eases the awkwardness of messaging first time digitally.

Hinge experienced an huge messages stating that ‘Open for a virtual date’ during the period January – March. It has also stated that Matches have also been increasing day by day where conversations growing rapidly. It shows that singles turning to online dating rapidly.

Bumble too shows the overall increasing in their data depicts the increased use of app by new and existing users regularly which indicates chats, video calls and voice calls have been played significant roles. They also stated that with an average of 21 minute call duration on an average.

Dating Fatigue?

There’s no reason to rush conversations or skip interesting topics. Use this time to learn all about your potential love matches. You may discover that you have more in common than you originally thought (or not). This will help you to whittle down your post-quarantine dating shortlist.

Until you feel comfortable, it’s best to keep the conversation going within the dating app. If someone tries to convince you to move the conversation to WhatsApp or Messenger too early, they could be trying to scam you.

Author: Mihir Bommisetty

DATA SCIENCE – INSIGHTS

DATA SCIENTIST – DATA ANALYST – DATA ENGINEER

If you’re confused with the step to choose a career in Data science, Data needs a huge number of people. There is an “obtuse of opportunities and acute shortage for data professionals“.

Who are these professionals?????

Professionals, who are able to obtain insights and make supervised conclusions from the data available are high in demand in the country like INDIA.

Let’s dive deep into DATA SCIENCE.

Who are DATA ENGINEERS and what are their responsibilities???

Data Engineers are solely responsible for the preparation of data in an organized and quick accessible to the company they are in. Data Analysts and Data Scientists use this data to bring out the insights which can be the solutions for the business to enhance and develop data.

Responsibilities:

Create, install, run & maintain data bases along with storing of all related data points.
Test and Certify whether the data meets industry requirements and their practical practices.
Exploring new management technologies to handle data and tools.
Good communication and team spirit to work with relation designers, data architects & software team to reach project deadlines.

Skills required by Data Engineer:

Technical Skills: one should good at programming to develop test data. Knowledge in distributed computing is essential for parallel programming along with software. Being a software engineer they should be familiar with Agile SDLC, DevOps to develop pipelines for managing data across systems. Obviously data scientist should be an expert in SQL and additional query languages.
Collaborative Communication: Good at listening data architects, scientists and their management decisions to reach their expectations and the requirements of the organization. Because you are responsible for the data you developed in the organization you are responsible to make data easily retrievable by any other in the organization.
Intellectual Industry Knowledge: One should be able to understand the working dynamics of the industry and the usage of data, the application of development of data required.

Who are DATA ANALYST and what are their responsibilities???

This includes, analyzing the data and obtaining insights frim the data. Analysts will be dealing with Exploratory data analysis and machine learning techniques for the continuous analyzation of data. Analysts help their organization to know about:

Marketing strategies & post production sales.
Optimization of resource usage.

Skills required by a DATA ANALYST:

Business Domain Knowledge – Data Analysts are business problem solvers. Therefore, they need to have an acute understanding of the business, in order to clearly define the problem and come up with quantitative solutions.
Analytical and Statistical Skills – Data Analysts operate with large quantities of data, figures, facts and crunch numbers. They need to know statistical and machine learning techniques to analyze the data in order to reach conclusions and be able to make recommendations. They should be familiar with areas of Exploratory Data Analysis, Hypothesis Testing and Machine Learning.
Technical Skills: Data Analysts sift through huge amounts of data. They need to know specialized languages like R and Python to perform analysis and be familiar with SQL to manage data and derive quick trends.
Communication Skills – Data Analysts are often required to present findings or decipher the data into an understandable manuscript. They must communicate complex ideas in the best way possible.

Data Scientists fits in?

A Data Scientist embodies the perfect combination of business knowledge, technical expertise and statistics. As a Data Scientist your job is not to simply draw insights and trends from the data collected over a period of time, but to also create machine learning systems which organizations can deploy final products to automate decision making.

Like other data professionals, as a Data Scientist, you would be expected to know how to retrieve data from varied sources. Additionally, to create algorithms to find hidden trends and patterns, and how to develop appropriate conclusions. Therefore, you will need to know concepts like data preparation and exploration to gather and understand data. Machine learning to create predictive systems. And, a bit of software engineering too in order to create a product.

Skills required for a DATA SCIENTIST:

Knowledge in algorithms, statistics, mathematics and machine learning.
Programming languages such as R, Python, SQL, and Hive.
Business strategies understanding and the aptitude to frame the right questions to ask, and find answers in the available data.
Communication skills in order to communicate the results effectively to the rest of the team and the end users.

To Conclude:

The Data Engineer looks into the data needs of the organization they are in. Data Analysts provide insights from the data they are working. Data Scientists create data products which can make the user experience errorless. It is important to keep in mind that these roles and responsibilities varies from the organization to organization.

Author:

MIHIR BOMMISETTY