AugmntX

AugmntX is the world’s largest network of pre-vetted talent.

Contact Info

305, IRIS Corporate Centre,
Hiranandani Meadows, 400610.
hello@augmntx.com
+919820045154

Follow Us

Home / Developers / AXO630
profile image
Vineet kumar C AXO630 Active
Software Developer in Chennai
Organized, collaborative, and skilled 1 year of trained experience in Pyspark along with data bricks. Hands-on experience in installing, configuring, and using Apache Spark Understanding of Spark Architecture including Spark core, spark SQL. Good Knowledge of Accumulator variables, Broad cast variables, RDD (Transformations and actions), and Data Frame. Data cleaning of artifacts (missing values, wrong data, wrong value, etc...). Good knowledge of Python and SQL & Basic knowledge of Cloud (AWS).
Industries : Ecommerce
Share
Hire Vineet kumar C
Download PDF
Availability
Full-time
Total experience
2 years
Technical skills
Python
2 Years
Pyspark
2 Years
DataBricks
2 Years
MongoDB
2 Years
MySQL
2 Years
Python
Projects
Web scraping (Python)
Description
This project aims to scrape real estate data from a popular real estate website and store the data in a structured format for further analysis. The website contains information about different properties such as price, location, size, number of bedrooms and bathrooms, and other details. The project will involve the following steps: Identify the website and data to be scraped: In this case, we will select a popular real estate website and identify the information we want to extract. Analyze the website structure: We will analyze the website structure and determine the HTML tags and attributes needed to extract the desired data. We will use the BeautifulSoup library for parsing HTML and navigating the website structure. Write the web scraping script: We will write a Python script to extract the data from the website. The script will use the requests library to fetch the website content, and BeautifulSoup to extract the relevant information. Store the data in a structured format: Once the data is extracted, we will store it in a structured format such as CSV, JSON, or a database. This will enable us to easily analyze the data using Excel, Python, or R tools. Automate the process: We will set up the script to run regularly, such as daily or weekly, to ensure that we have the most up-to-date data.
Roles and Responsibilities
Designed and implemented web scraping scripts in Python to extract data from websites. Developed a code to handle web content of HTML. Debugging and testing web scraping scripts to ensure they are extracting the desired information accurately and efficiently. Storing the extracted data in a text file. Ensuring the web scraping scripts adhere to ethical and legal standards for web scraping.
Technologies: Python
Industry: Ecommerce
Web scraping (Python)
Description
This project aims to scrape real estate data from a popular real estate website and store the data in a structured format for further analysis. The website contains information about different properties such as price, location, size, number of bedrooms and bathrooms, and other details. The project will involve the following steps: Identify the website and data to be scraped: In this case, we will select a popular real estate website and identify the information we want to extract. Analyze the website structure: We will analyze the website structure and determine the HTML tags and attributes needed to extract the desired data. We will use the BeautifulSoup library for parsing HTML and navigating the website structure. Write the web scraping script: We will write a Python script to extract the data from the website. The script will use the requests library to fetch the website content, and BeautifulSoup to extract the relevant information. Store the data in a structured format: Once the data is extracted, we will store it in a structured format such as CSV, JSON, or a database. This will enable us to easily analyze the data using Excel, Python, or R tools. Automate the process: We will set up the script to run regularly, such as daily or weekly, to ensure that we have the most up-to-date data.
Roles and Responsibilities
Designed and implemented web scraping scripts in Python to extract data from websites. Developed a code to handle web content of HTML. Debugging and testing web scraping scripts to ensure they are extracting the desired information accurately and efficiently. Storing the extracted data in a text file. Ensuring the web scraping scripts adhere to ethical and legal standards for web scraping.
Technologies: Python
Industry: Ecommerce
Work history
Software Developer • March-2022
Description: I have worked on SQL to handle RDBMS of large data processing, and hands-on practices about joins and stored procedures4. Identifying areas for modification in existing programs and subsequently developing these modifications. I have worked on Asp.net core web API in the MOE project. Working on ATS Bug Fixing and working on ATS Documentation.Processing and cleaning data, formalizing business problems and creating solutions by designing features and applying machine learning techniques to solve the problems. Testing and debugging applications. Developing back-end components. Integrating user-facing elements using server-side logic.
Soft skills
Communication
Teamwork
Problem-solving
Education
Bachelors degree in BE.ECE
Agni College of Technology
2014 to 2018
Language
English - Native