Building AI-Powered Automation Tools With Three NLP-Based APIs
The evolution of Artificial Intelligence (AI) and Natural language processing (NLP) has opened doors to myriads of possibilities for automating complex tasks, enhancing efficiency and delivering valuable insights with the help of technology. No wonder that the demand for intelligent solutions is surging, and the global AI market size is expected to reach 738.80 billion USD by 2030 from 241.80 billion USD in 2023.
If you are considering the implementation of AI automation at your organization or are in search of solutions that speed up AI software development, you have come to the right place.
In this article, we will walk you through the main technical aspects of AI and NLP, explore a few AI Application Programming Interfaces (APIs) that make it easier to build intelligent features. What’s more, we will provide you with the steps necessary to incorporate DataForSEO’s AI-powered APIs to build automation tools for various tasks, including content creation, competitor analysis, and Google results summarization.
Contents:
What is Natural Language Processing (NLP) and How It’s Changing the Web
Navigating the NLP Development Landscape
NLP in DataForSEO APIs: Content Generation, Content Analysis, AI SERP Summary
3 Use Cases For Harnessing AI-Powered Automation
What is Natural Language Processing (NLP) and How It’s Changing the Web
Natural language processing (NLP) is a branch of AI, a machine learning (ML) technology that processes datasets of natural language (any language that naturally emerged in a human community) and enables computers to understand, interpret and reproduce human language in a meaningful way.
A simple example of NLP in action is typing a query into the Google Search bar. As you start typing, Google will try to predict the full search phrase.
This feature is called Google autocomplete predictions and it works based on NLP and machine learning algorithms. They help the search engine predict what you are going to type next by considering popular queries related to your input, as well as your previous searches, your location, query language, and word patterns from the web.
The search engine also uses NLP-powered algorithms to interpret the query and provide relevant results. Machine learning models like BERT and MUM are fed via natural language processing and applied for understanding search phrases, analyzing content across the web, compiling featured snippets, and ranking websites on the
results pages.
The search engines are just one instance of an NLP application, but the examples and potential use cases are vast. To name a few, NLP is:
- Enabling chatbots and virtual assistants to understand and respond to user queries;
- Improving automated language translation services;
- Enhancing web apps with grammar and spell-checking capabilities;
- Making website content more accessible with text-to-speech and speech-to-text conversion;
- Helping with the detection of fake news, false and misleading information;
- Empowering businesses with web sentiment analysis functionalities ;
- Automating the generation of content, summaries and product descriptions.
As you can see, NLP is reshaping the way we interact with web technology in numerous contexts. Sure enough, the number of organizations seeking to harness the power of natural language processing is growing. However, building a robust NLP model involves a series of technical complexities which we’ll navigate through below.
Navigating the NLP Development Landscape
In the previous part, we’ve established that NLP is acting as a bridge between human language and computational power. Now, let’s explore what it takes to build this bridge.
First things first, you should understand that at its core NLP is an interdisciplinary field that combines computer science, deep learning, and linguistics.
Computer science is needed to work with vast volumes of data, deep learning allows the model to autonomously learn similarly to the human brain, and linguistics helps to unscramble syntax, semantics and other challenging aspects of human language.
To illustrate how these components work in synergy, we’ll go through the NLP implementation steps:
Pre-processing
First off, NLP software processes and cleans raw textual data to make it suitable for further analysis and training. This stage involves a range of techniques, such as:
- Tokenization: splitting text and sentences into individual units (tokens).
- Stemming: reducing words to their root form.
- Lowercasing: ensuring uniformity by converting all text to lowercase.
- Stop word removal: removing words that add little meaning (for, with).
- Noise handling: dealing with spelling correction, acronyms, slang, and other non-standard language.
Training
At this stage, NLP algorithms are trained on pre-processed data to prepare for specific use cases. Key points are:
- Converting text into vectors with TF-IDF or Word2Vec
- Selecting task handling architecture (Recurrent Neural Networks, Transformers, etc.)
- Employing supervised or unsupervised machine learning
- Optimizing performance
- Creating a training loop (e.g., using Gradient Descent)
Deployment
Finally, the NLP model is deployed and integrated into the necessary system to work on new data. The deployment includes:
- Incorporating the model via API or frameworks
- Ensuring scalability and security
- Implementing performance tracking and A/B testing
- Establishing periodical retraining of the model
Overall, developing a natural language processing model is incredibly complex and resource-intensive. In order to avoid unnecessary challenges, businesses opt for alternative solutions that accelerate the development process and are ready to be deployed. These solutions encompass pre-trained models like BERT or GPT, open-source NLP libraries, NLP APIs, or mission-tailored APIs powered with NLP, such as Sentiment Analysis API.
NLP in DataForSEO APIs: Content Generation, Content Analysis, AI SERP Summary
DataForSEO provides a range of application programming interfaces (APIs) that leverage Natural Language Processing (NLP) technology. Each API is designed for performing specific tasks and delivering data that is ready to be integrated for your custom purposes. Below, we’ll give you a quick overview of these APIs and their essential features.
Content Generation API
DataForSEO’s Content Generation API is an efficient NLP-based solution for automating multiple content-related tasks, from streamlining content creation to accelerating content optimization.
The API incorporates a range of techniques that enable our NLP model to:
- Produce engaging and unique articles, social media posts, emails, and more
- Generate meta tags
- Suggest subtopics for a main topic
- Paraphrase your content
- Detect grammar and spelling mistakes
- Provide a detailed content analysis with word count, readability, keyword density, and more.
To ensure the output content aligns with SEO best practices and is similar in style, Content Generation API also uses sophisticated machine learning algorithms that generate words or phrases based on previous output. Note that the generated text is plagiarism-free, but we recommend adding a final touch from a human editor.
To learn more about the Content Generation API and features that can be built with it in this article.
Content Analysis API
The DataForSEO Content Analysis API is designed to boost brand monitoring with robust sentiment analysis capabilities. Working atop our advanced NLP model, this API offers an effortless way to spot citations of target keywords, products, or brands from across the web, and instantly categorize the sentiments enveloping each citation.
Trained on substantial volumes of carefully selected data, this model can accurately identify and score not only positive, negative, and neutral sentiment polarity, but also emotional reactions like anger, happiness, love, sadness, fun and desire to share content.
In addition to discovering mentions and deciphering their sentiment, Content Analysis API provides dedicated endpoints for reviewing citation and sentiment trends by category or by keyword. Importantly, the API supports over 70 languages.
Discover more: Using Content Analysis API to Detect the Sentiment of Web Mentions
AI Summary in SERP API
The AI Summary endpoint in SERP API is the latest addition to the DataForSEO suite of AI-powered tools. It utilizes advanced NLP algorithms to summarize data from search engine results pages (SERPs) and deliver key insights. The endpoint is also customizable, it offers several options that can instruct the algorithms to:
- Consider the content of top-ranked websites when generating a summary.
- Account for SERP features (
answer_box,knowledge_graph,featured_snippet) in addition to organic results. - Produce a response based on a custom prompt.
Note that the AI Summary endpoint works together with the SERP API and is compatible with all SERP API search engines. To start using it, you should first set a task to collect search results data, and then specify the ID of that task making an API call with the AI Summary.
You can learn more about the AI Summary from our documentation, which includes detailed instructions and code examples.
As a final point, we’d like to note that DataForSEO offers APIs on a pay-as-you-go basis, ensuring affordability without compromising on quality. Using our solutions, you can perform custom content and SERP analysis or craft your tailor-made software under budget.
For a deeper dive into the world of AI-powered automation and potential use cases for NLP-driven APIs, keep on reading.
3 Use Cases For Harnessing AI-Powered Automation
When it comes to the development of AI-powered software that leverages advanced algorithms, machine learning, and Natural Language Processing (NLP), it may be rather challenging to make all of the components work together in harmony.
To help you navigate through the development process with ease, we will provide you with step-by-step instructions demonstrating how to harness the power of DataForSEO APIs to automate several tasks with AI.
Content Creation
Content creation is one of the most common use cases for AI automation. It allows businesses to significantly speed up and scale the process of writing articles, product descriptions, social media posts, newsletters, and more.
With the DataForSEO AI SERP Summary and Content Generation API, you can leverage robust data summarization and natural language generation techniques to produce coherent and relevant content.
Let’s take a look at how to use these solutions to analyze your competitors, generate a blog post plan, and create a full-fledged article that will challenge your rivals in SERPs.
First off, make a request to the Organic Google SERP API with a keyword relevant to your business and target location. For an example query, we’ll use “how to pick a couch” for this location: Florida, US.
Tip: If you don’t know how to pick a keyword, try generating Keywords For Site with the DataForSEO Labs API. To be more specific in your research, you can filter the results by commercial search intent to obtain a list of keywords that are most relevant to the pre-purchase exploration stage and thus will be most helpful for building trustful relationships with your potential customers.
Step 1. POST: https://api.dataforseo.com/v3/serp/google/organic/task_post
[
{
"language_name": "English",
"location_name": "Florida,United States",
"keyword": "how to pick a couch",
"device": "desktop"
}
]
Once you receive a response there’s no need to manually go through the top-ranking pages. Simply use the task ID (example: “id”: “09131420-1535-0066-0000-9208ccf0767a”) to make a request to the AI Summary endpoint, and our algorithm will fetch the content from pages featured in the results to generate a quick summary. You can additionally define a precise task for our AI using a custom prompt.
Step 2. POST: https://api.dataforseo.com/v3/serp/ai_summary
[
{
"task_id": "09131420-1535-0066-0000-9208ccf0767a",
"prompt": "provide titles of top results and a full summary of content for each result",
"include_links": true,
"fetch_content": true,
"suport_extra": true
}
]
{
"version": "0.1.20230825",
"status_code": 20000,
"status_message": "Ok.",
"time": "22.8242 sec.",
"cost": 0.01,
"tasks_count": 1,
"tasks_error": 0,
"tasks": [
{
"id": "09131428-1535-0559-0000-6b9d6ed39e11",
"status_code": 20000,
"status_message": "Ok.",
"time": "22.7667 sec.",
"cost": 0.01,
"result_count": 1,
"path": [
"v3",
"serp",
"ai_summary"
],
"data": {
"api": "serp",
"function": "ai_summary",
"task_id": "09131420-1535-0066-0000-9208ccf0767a",
"prompt": "provide titles of top results and a full summary of content for each result",
"include_links": true,
"fetch_content": true,
"suport_extra": true
},
"result": [
{
"items_count": 1,
"items": [
{
"summary": "Title of top result: How to Choose the Perfect Sofa for Your Living Space [https://www.bhg.com/couch-buying-guide-7370559]\nSummary of content: This article provides tips on how to choose the perfect sofa for your living space. It suggests starting by picking a style that complements your design aesthetic. It also emphasizes the importance of considering factors like price point, comfort, quality, color, and additional features like stain-resistant fabric. The article aims to simplify the task of choosing a sofa by outlining the most important details to consider during the shopping process.\nTitle of second result: The Complete Guide on How to Buy a Sofa [https://www.apartmenttherapy.com/how-to-buy-sofa-36809606]\nSummary of content: This comprehensive guide provides valuable information on buying a sofa. It emphasizes the importance of considering both aesthetic and practical factors when making a purchase. The article suggests that comfort should be a priority and discusses how to ensure you're sourcing the right piece, especially when buying online. It also discusses the components that make up a quality sofa and provides helpful tips for making an informed decision.\nTitle of fourth result: How to Buy a Good Couch [https://www.thespruce.com/tips-for-buying-a-great-sofa-1391218]\nSummary of content: This article focuses on buying a good quality couch that will stand the test of time. It emphasizes the importance of considering factors like how the couch will be used, the space it will be in, and the style of the room. The article also discusses the difference between a couch and a sofa and provides tips on reviving an aging couch or replacing it if necessary.\nTitle of fifth result: The Ultimate Guide to Buying a Sofa That Will Stand the Test of Time [https://www.housebeautiful.com/home-remodeling/interior-designers/tips/a1092/sofa-buying-guide/]\nSummary of content: This guide highlights the significance of buying a sofa that will last and define your space. It discusses the construction of a well-constructed sofa, including the importance of a wooden frame that is kiln-dried. The article also provides tips for selecting the perfect sofa based on your lifestyle and preferences.\nTitle of sixth result: 8 Tips For Choosing the Perfect Sofa [https://www.universalexplorehome.com/2020/07/15/8-tips-for-choosing-the-perfect-sofa/]\nSummary of content: This article offers eight tips for choosing the perfect sofa. It suggests considering your lifestyle and requirements, such as the need for a sectional or stain-resistant upholstery. It also advises measuring the space and taking into account the orientation of the sofa. The article provides additional tips for selecting the right sofa for your home.\nNote: The analysis includes the ranking of each website in the google SERP."
}
]
}
]
}
]
}
Now that we have an idea about the websites and the type of content that rank well, we can use these insights to create a comprehensive blog post for our target business. For example, we can pick one of the ranked results to Paraphrase its title and content summary, and then use the title to Generate Subtopics and obtain an outline for our blog post with the Content Generation API.
Step 3. POST: https://api.dataforseo.com/v3/content_generation/paraphrase/live
[
{
"text": "Title: The Ultimate Guide to Buying a Sofa That Will Stand the Test of Time. Summary of content: This guide highlights the significance of buying a sofa that will last and define your space. It discusses the construction of a well-constructed sofa, including the importance of a wooden frame that is kiln-dried. The article also provides tips for selecting the perfect sofa based on your lifestyle and preferences.",
"creativity_index": 0.3
}
]
{
"version": "0.1.20230825",
"status_code": 20000,
"status_message": "Ok.",
"time": "4.0411 sec.",
"cost": 0.01425,
"tasks_count": 1,
"tasks_error": 0,
"tasks": [
{
"id": "09131440-1535-0503-0000-37776669340c",
"status_code": 20000,
"status_message": "Ok.",
"time": "3.9669 sec.",
"cost": 0.01425,
"result_count": 1,
"path": [
"v3",
"content_generation",
"paraphrase",
"live"
],
"data": {
"api": "content_generation",
"function": "paraphrase",
"text": "Title: The Ultimate Guide to Buying a Sofa That Will Stand the Test of Time. Summary of content: This guide highlights the significance of buying a sofa that will last and define your space. It discusses the construction of a well-constructed sofa, including the importance of a wooden frame that is kiln-dried. The article also provides tips for selecting the perfect sofa based on your lifestyle and preferences.",
"creativity_index": 0.3
},
"result": [
{
"input_tokens": 95,
"output_tokens": 75,
"new_tokens": 75,
"generated_text": "Title: How to Choose a Sofa That Will Last a Lifetime. Summary of content: This guide offers practical advice on selecting a sofa that will stand the test of time. It covers the key factors to consider when choosing a sofa, such as the quality of the materials used, the durability of the frame, and the comfort level."
}
]
}
]
}
Step 4. POST: https://api.dataforseo.com/v3/content_generation/generate_sub_topics/live
[
{
"topic": "How to Choose a Sofa That Will Last a Lifetime",
"creativity_index": 0.9
}
]
{
"version": "0.1.20230825",
"status_code": 20000,
"status_message": "Ok.",
"time": "5.6213 sec.",
"cost": 0.0001,
"tasks_count": 1,
"tasks_error": 0,
"tasks": [
{
"id": "09131444-1535-0543-0000-e3b562478e10",
"status_code": 20000,
"status_message": "Ok.",
"time": "5.5858 sec.",
"cost": 0.0001,
"result_count": 1,
"path": [
"v3",
"content_generation",
"generate_sub_topics",
"live"
],
"data": {
"api": "content_generation",
"function": "generate_sub_topics",
"topic": "How to Choose a Sofa That Will Last a Lifetime",
"creativity_index": 0.9
},
"result": [
{
"input_tokens": 110,
"output_tokens": 236,
"new_tokens": 236,
"sub_topics": [
"Choosing the Right Materials",
"Considering Comfort and Support",
"Measuring for the Perfect Fit",
"Budgeting for a High-Quality Sofa",
"The Importance of Quality Upholstery",
"How to Select the Right Sleeper Sofa",
"The Benefits of Investing in a Custom Sofa",
"Evaluating the Durability of a Sofa",
"Tips for Caring for Your Sofa to Extend Its Lifespan",
"The Impact of Sofa Design on Resale Value"
]
}
]
}
]
}
Once we have everything we need, we can finally specify the main topic and the subtopics to Generate Text of the full article.
Step 5. POST: https://api.dataforseo.com/v3/content_generation/generate_text/live
[
{
"topic": "How to Choose a Sofa That Will Last a Lifetime",
"sub_topics": [
"Choosing the Right Materials",
"Considering Comfort and Support",
"Measuring for the Perfect Fit",
"Budgeting for a High-Quality Sofa",
"The Importance of Quality Upholstery",
"How to Select the Right Sleeper Sofa",
"The Benefits of Investing in a Custom Sofa",
"Evaluating the Durability of a Sofa",
"Tips for Caring for Your Sofa to Extend Its Lifespan",
"The Impact of Sofa Design on Resale Value"
],
"description": "This guide highlights the significance of buying a sofa that will last and define your space. The article also provides tips for selecting the perfect sofa based on your lifestyle and preferences.",
"meta_keywords": [
"buy a sofa",
"buy a couch",
"how to pick a couch"
],
"creativity_index": 0.8,
"word_count": 1000
}
]
{
"version": "0.1.20230825",
"status_code": 20000,
"status_message": "Ok.",
"time": "45.1599 sec.",
"cost": 0.0525,
"tasks_count": 1,
"tasks_error": 0,
"tasks": [
{
"id": "09131450-1535-0502-0000-3089defcc08d",
"status_code": 20000,
"status_message": "Ok.",
"time": "45.1382 sec.",
"cost": 0.0525,
"result_count": 1,
"path": [
"v3",
"content_generation",
"generate_text",
"live"
],
"data": {
"api": "content_generation",
"function": "generate_text",
"topic": "How to Choose a Sofa That Will Last a Lifetime",
"sub_topics": [
"Choosing the Right Materials",
"Considering Comfort and Support",
"Measuring for the Perfect Fit",
"Budgeting for a High-Quality Sofa",
"The Importance of Quality Upholstery",
"How to Select the Right Sleeper Sofa",
"The Benefits of Investing in a Custom Sofa",
"Evaluating the Durability of a Sofa",
"Tips for Caring for Your Sofa to Extend Its Lifespan",
"The Impact of Sofa Design on Resale Value"
],
"description": "This guide highlights the significance of buying a sofa that will last and define your space. The article also provides tips for selecting the perfect sofa based on your lifestyle and preferences.",
"meta_keywords": [
"buy a sofa",
"buy a couch",
"how to pick a couch"
],
"creativity_index": 0.8,
"word_count": 1000,
"include_conclusion": true
},
"result": [
{
"input_tokens": 288,
"output_tokens": 1050,
"new_tokens": 1050,
"generated_text": "When it comes to choosing a sofa, you want to make sure you're making a smart investment that will last for years to come. But with so many options on the market, it can be tough to know where to start. Fortunately, by considering a few key factors, you can find a sofa that not only looks great but also provides lasting comfort and support.\nChoosing the Right Materials\n-------------------\n\nThe materials used in a sofa are a crucial factor in determining its durability and lifespan. Look for sofas made with high-quality materials such as solid wood frames, durable fabrics, and comfortable cushioning. Avoid sofas with flimsy frames or low-quality materials that may break down quickly.\nConsidering Comfort and Support\n-------------------------\n\nComfort and support are essential when it comes to a sofa. Look for a sofa that provides adequate cushioning and support for your body. Consider the seat depth and height, as well as the armrest height and width. A sofa that provides the right amount of support will help prevent back and neck strain.\nMeasuring for the Perfect Fit\n-----------------------\n\nMeasuring your space and your body is crucial when choosing a sofa. Make sure you have enough space to accommodate the sofa comfortably, and consider how you'll use the space. A sofa that is too small or too large for your space can be uncomfortable and difficult to use.\nBudgeting for a High-Quality Sofa\n---------------------\n\nWhile it's important to invest in a high-quality sofa, it's also important to set a budget and stick to it. Avoid overspending on a sofa that may not provide the quality and comfort you need. Consider the cost of the sofa, as well as any additional costs such as delivery and assembly.\nThe Importance of Quality Upholstery\n------------------\n\nThe upholstery of a sofa is another important factor to consider. Look for sofas with high-quality upholstery that is durable and easy to clean. Avoid sofas with cheap or flimsy upholstery that may wear out quickly.\nHow to Select the Right Sleeper Sofa\n--------------------\n\nIf you're looking for a sofa that can convert into a bed, consider the size and comfort of the sleeper section. Make sure the sleeper section is large enough to accommodate a comfortable night's sleep, and look for a sofa with a sturdy frame that can support the weight of multiple people.\nThe Benefits of Investing in a Custom Sofa\n---------------------\n\nWhile pre-made sofas have their advantages, investing in a custom sofa can provide unparalleled comfort and style. A custom sofa can be tailored to your specific needs and preferences, providing a unique and comfortable seating solution.\nEvaluating the Durability of a Sofa\n------------------------\n\nWhen evaluating the durability of a sofa, consider the materials used, as well as the construction and design. Look for sofas with sturdy frames and high-quality materials that will withstand the test of time. Avoid sofas with flimsy frames or low-quality materials that may break down quickly.\nTips for Caring for Your Sofa to Extend Its Lifespan\n------------------\n\nProper care and maintenance can help extend the lifespan of your sofa. Avoid exposing your sofa to direct sunlight or extreme temperatures, and vacuum regularly to remove dirt and debris. Consider using a sofa protector to protect the upholstery and extend the life of your sofa.\nThe Impact of Sofa Design on Resale Value\n------------------\n\nThe design of your sofa can have a significant impact on its resale value. Choose a sofa with a timeless design that will appeal to potential buyers. Avoid sofas with trendy designs that may go out of style quickly, as they may lower the resale value of your home.",
"supplement_token": "FOQDXQ"
}
]
}
]
}
This fast and easy, DataForSEO AI has helped us to produce a complete draft for an article that will help our business to get featured in SERP for “how to pick a couch” in Florida, US.
If you’d like to go further, you can use the supplement_token to continue the generation. Also, you can Generate Meta Tags for this text, that is, title and description tags. You can as well try experimenting with the AI SERP Summary insights to improve click-through rates and user engagement: request the AI SERP Summary to fetch titles and descriptions featured in the results, and then use some of them as the target text to Generate Meta Tags for your blog post.
Don’t hesitate to test AI SERP Summary and Content Generation API on the examples that will be relevant to your business.
Competitor Analysis
Analyzing your competition is a vital part of any digital marketing strategy. AI automation can take your competitor analysis to a new level by allowing you to delve into the vast expanse of the web in a matter of seconds.
Our Content Analysis API can scan millions of web resources to provide you with mentions of a target competitor or their product, along with the related sentiment.
All you have to do is define a target keyword when setting a task to the Search endpoint.
For example, let’s try to find the most trusted resources mentioning Maiden Home The Jones Modular sofa and discover the tone used when referring to this product.
POST: https://api.dataforseo.com/v3/content_analysis/search/live
[
{
"keyword": "Maiden Home The Jones Modular",
"keyword_fields": {
"snippet": "Maiden Home The Jones Modular"
},
"page_type": [
"news",
"blogs",
"message-boards",
"organization"
],
"search_mode": "one_per_domain",
"filters": [
"country",
"=",
"US"
],
"internal_list_limit": 5,
"order_by": [
"domain_rank,desc"
],
"limit": 2
}
]
The returned data will help you to uncover not only the keyword mentions, but also the domains and domain strength of each resource that mentions it. Our API will also deliver you the text snippet containing the target keyword, and the DataForSEO AI will determine the sentiment and emotional reactions that wrap each citation.
{
"version": "0.1.20230825",
"status_code": 20000,
"status_message": "Ok.",
"time": "0.2233 sec.",
"cost": 0.02006,
"tasks_count": 1,
"tasks_error": 0,
"tasks": [
{
"id": "09131518-1535-0463-0000-80dfa4af649b",
"status_code": 20000,
"status_message": "Ok.",
"time": "0.1866 sec.",
"cost": 0.02006,
"result_count": 1,
"path": [
"v3",
"content_analysis",
"search",
"live"
],
"data": {
"api": "content_analysis",
"function": "search",
"keyword": "Maiden Home The Jones Modular",
"keyword_fields": {
"snippet": "Maiden Home The Jones Modular"
},
"page_type": [
"news",
"blogs",
"message-boards",
"organization"
],
"search_mode": "one_per_domain",
"filters": [
"country",
"=",
"US"
],
"order_by": [
"domain_rank,desc"
],
"limit": 2
},
"result": [
{
"offset_token": "eyJDdXJyZW50T2Zmc2V0IjoyLCJSYXdSZXF1ZXN0Ijp7ImtleXdvcmQiOiJNYWlkZW4gSG9tZSBUaGUgSm9uZXMgTW9kdWxhciIsImtleXdvcmRfZmllbGRzIjp7InNuaXBwZXQiOiJNYWlkZW4gSG9tZSBUaGUgSm9uZXMgTW9kdWxhciJ9LCJwYWdlX3R5cGUiOnsidHlwZXMiOlsibmV3cyIsImJsb2dzIiwibWVzc2FnZS1ib2FyZHMiLCJvcmdhbml6YXRpb24iXSwibWVyZ2UiOiJvciJ9LCJzZWFyY2hfbW9kZSI6Im9uZV9wZXJfZG9tYWluIiwicXVlcnkiOnsiZmllbGQiOiJjb3VudHJ5IiwidHlwZSI6ImVxIiwidmFsdWUiOiJVUyJ9LCJvcmRlcl9ieSI6eyJvcmRlcl9maWVsZCI6ImRvbWFpbl9yYW5rIiwib3JkZXJfdHlwZSI6ImRlc2MifSwibGltaXQiOjIsImFpZCI6MTUzNX0sIlNlYXJjaEFmdGVyRGF0YSI6eyJWZXJzaW9uIjoxLCJTZWFyY2hBZnRlclZhbHVlcyI6eyJkb21haW5fcmFuayI6MTU2MDYyMTguMCwiX3Njb3JlIjo0MTA3OS41NCwidXJsX2hhc2giOiItNzYzMTAxNzk0OTA5MjAzMjI5MyJ9LCJUb2tlblJlYWxPZmZzZXQiOjB9fQ==",
"total_count": 18,
"items_count": 2,
"items": [
{
"type": "content_analysis_search",
"url": "https://www.aol.com/lifestyle/22-cozy-seating-arrangements-midday-132300710.html",
"domain": "www.aol.com",
"main_domain": "aol.com",
"url_rank": 0,
"spam_score": 0,
"domain_rank": 687,
"fetch_time": "2023-07-09 23:31:43 +00:00",
"country": "US",
"language": "en",
"score": 44387.812,
"page_category": [
10009,
10413,
11574,
12818,
10405,
10021,
10178,
10937,
12263
],
"page_types": [
"news"
],
"ratings": null,
"social_metrics": null,
"content_info": {
"content_type": "page_content",
"title": "The Jones Modular",
"main_title": "The Most Comfortable Couches You Can Buy Online, According to Design Pros",
"previous_title": "Atelier Sofa",
"level": 2,
"author": "Isis Briones, Medgina Saint-Elien, Jessica Cherner",
"snippet": "Few brands craft luxurious sofas like Maiden Home. Rather than offer their loyal clients a bevy of options, which, more often than not, are more stressful than helpful, Maiden Home sells 13 styles, including The Jones, a modular option we are shamelessly obsessed with. We love it in the sea foam green pictured, but if you're into something more neutral, opt for any of the brand's myriad fabric options. Plus, it comes with free white glove delivery because it's made to order, meaning no one is going into a warehouse and pulling out a sofa that's been sitting on a shelf for months.",
"snippet_length": 586,
"social_metrics": null,
"highlighted_text": null,
"language": "en",
"sentiment_connotations": {
"anger": 0.06424564123153687,
"happiness": 0.28066372871398926,
"love": 0.20608040690422058,
"sadness": 0.10792048275470734,
"share": 0.13618203997612,
"fun": 0.2049676775932312
},
"connotation_types": {
"positive": 0.25451037287712097,
"negative": 0.11579282581806183,
"neutral": 0.6297268271446228
},
"text_category": [
10108,
10009,
10405,
10013
],
"date_published": "2023-06-02 16:38:00 +00:00",
"content_quality_score": 95,
"semantic_location": "article",
"rating": null,
"group_date": "2023-06-02 16:38:00 +00:00"
}
},
{
"type": "content_analysis_search",
"url": "https://onehousing.us/best-made-sofa/",
"domain": "onehousing.us",
"main_domain": "onehousing.us",
"url_rank": 0,
"spam_score": 0,
"domain_rank": 470,
"fetch_time": "2023-08-23 20:35:25 +00:00",
"country": "US",
"language": "en",
"score": 41079.54,
"page_category": [
10004,
10108,
10756,
10009,
10405
],
"page_types": [
"cms",
"blogs",
"organization"
],
"ratings": null,
"social_metrics": null,
"content_info": {
"content_type": "page_content",
"title": "1. Maiden Residence",
"main_title": "The 27 Best Sofa Brands for 2023",
"previous_title": "Excessive-Finish Sofas",
"level": 3,
"author": "myhouse",
"snippet": "Beginning value: Sofas begin at round $2,100.\nWith regards to your own home, Maiden Residence believes you shouldn’t settle-for generic design, lesser high quality or something in need of an ideal match. Every of its sofas is handmade to order by craftsman companions in North Carolina—working with woodworking, cushion, tailoring, and fabric artisans which have every honed their craft from strategies handed down by generations.\nAssessment: We shipped Maiden Residence’s Varick Couch and matching ottoman to one among our contributors — learn the overview right here. We aslo shipped the Jones Modular Couch to one among our writers, take a look at the Jones overview right here.\n“Prospects hunt down Maiden Residence as a result of our design ethos and dedication to high quality is second to none,” founder Nidhi Kapur informed Dwelling Cozy. “Our prospects are people who wish to discover funding items for his or her house – the items they see themselves residing with for years, these that may stand the take a look at of time each aesthetically and functionally.” \nMerchandise: Maiden Residence gives a spread of sofas, sectionals and modular items.\n Supply: Customized items are prepared for supply in as little as 6 weeks from time of order. \nDelivery charges: Complimentary transport and white glove supply service with any furnishings order.\n↦ Store now at maidenhome.com",
"snippet_length": 1386,
"social_metrics": null,
"highlighted_text": null,
"language": "en",
"sentiment_connotations": {
"anger": 0.0571134053170681,
"happiness": 0.2957421839237213,
"love": 0.25315871834754944,
"sadness": 0.08308788388967514,
"share": 0.13912850618362427,
"fun": 0.17182937264442444
},
"connotation_types": {
"positive": 0.4710148274898529,
"negative": 0.18413496017456055,
"neutral": 0.34488028287887573
},
"text_category": [
10017,
10142,
10769,
12067,
10004,
10108
],
"date_published": "2023-08-18 15:20:05 +00:00",
"content_quality_score": 94,
"semantic_location": "article",
"rating": null,
"group_date": "2023-08-18 15:20:05 +00:00"
}
}
]
}
]
}
]
}
You can then use this opinion mining data to pinpoint the strengths and weaknesses of rival offerings and their company in general and shape your own strategy accordingly. For example, you can either replicate some of the competitor’s successful features or identify the pitfalls to steer clear of.
Additionally, you can monitor when a competitor’s product is mentioned on a certain resource to look for their brand affiliates and new platforms to engage with for promoting your product.
Google Results Summarization
Another use case where AI automation can be very helpful is generating summaries of Google search results. This data can be applied in several ways.
Google News Briefs
With the help of advanced NLP techniques, you can extract key information from the latest news pieces featured on Google News SERPs, and provide users with exhaustive briefs containing the most important events.
Question Answering
You can also leverage AI and SERP data to deliver question-answering systems, such as chat bots, virtual assistants, or custom software that is required to produce quick responses. So, once a user provides a query, the system will automatically request this data from SERP and an intelligent algorithm will summarize the results to return a compelling and relevant response.
Using our SERP API and the AI SERP Summary endpoint, obtaining the necessary intelligence and collecting data to power these solutions will be fast and simple.
As we have explained in the Content Creation section, you should first request SERP data. If you want to fetch Google News results, make an API call to the Task POST or Live endpoint of Google News SERP API.
If you are interested in collecting data from a conventional Google Search, use Organic Google SERP endpoints.
In the example below, we’ll fetch a news results page and then use the task ID from the response to generate a summary of the latest developments about Apple.
Step 1. POST: https://api.dataforseo.com/v3/serp/google/news/live/advanced
[
{
"language_name": "English",
"location_name": "Florida,United States",
"keyword": "apple",
"device": "desktop"
}
]
Copy task ID from the response: 09131532-1535-0066-0000-24a143486afc. If necessary, specify a prompt when setting a task to AI Summary.
Step 2. POST: https://api.dataforseo.com/v3/serp/ai_summary
[
{
"task_id": "09131532-1535-0066-0000-24a143486afc",
"prompt": "provide titles of top results and a full summary of content for each result",
"include_links": true,
"fetch_content": true,
"suport_extra": true
}
]
Here’s the final response with a generated news brief about the Apple company and its products.
{
"version": "0.1.20230825",
"status_code": 20000,
"status_message": "Ok.",
"time": "27.1968 sec.",
"cost": 0.01,
"tasks_count": 1,
"tasks_error": 0,
"tasks": [
{
"id": "09131532-1535-0559-0000-3e3813aeb5c5",
"status_code": 20000,
"status_message": "Ok.",
"time": "27.1364 sec.",
"cost": 0.01,
"result_count": 1,
"path": [
"v3",
"serp",
"ai_summary"
],
"data": {
"api": "serp",
"function": "ai_summary",
"task_id": "09131532-1535-0066-0000-24a143486afc",
"prompt": "provide titles of top results and a full summary of content for each result",
"include_links": true,
"fetch_content": true,
"suport_extra": true
},
"result": [
{
"items_count": 1,
"items": [
{
"summary": "Title of Result 1: Apple's $60 iCloud Service Is the Future of Apple\nSummary of Result 1: Apple announced new iCloud plans, called iCloud+, which offer 6 terabytes of cloud storage for $30 per month and 12 terabytes for $60 per month. The high cost is part of Apple's strategy to keep customers locked into its ecosystem by making it harder for them to switch to other services. The company aims to expand its services and subscription offerings in the future.\nTitle of Result 2: AI quietly reshapes Apple iPhones, Watches\nSummary of Result 2: Apple is using artificial intelligence (AI) to improve basic functions in its new iPhones and watches. The new devices feature improved semiconductor designs and a four-core \"Neural Engine\" that can process machine learning tasks up to twice as quickly. The AI components also enhance Siri, Apple's voice assistant, making it 25% more accurate. Unlike other companies, Apple is not pushing for significant transformations with AI, but rather focusing on enhancing user experience.\nTitle of Result 3: New Apple Leak Highlights Shock MacBook Pro Decision\nSummary of Result 3: There have been leaks suggesting that Apple's upcoming M3 launch may not include the expected MacBook Air and MacBook Pro laptops. These leaks have tempered expectations for Apple's October event, which was anticipated to include the launch of the M3 chipset along with new Mac products. Bloomberg's Mark Gurman suggests that Apple may opt for press releases to introduce new products instead of prerecorded announcement videos.\nTitle of Result 4: September 2023 Apple Event Spoiler-Free Video Stream [Video Posted]\nSummary of Result 4: Apple's latest \"Wonderlust\" media event is expected to be a pre-recorded presentation. The video will be made available for on-demand viewing shortly after the conclusion of the event. Users who want to avoid spoilers can gather in a designated thread until the video is posted. The timing for the availability of the video is expected to be similar to previous virtual events conducted by Apple.\nTitle of Result 5: Apple’s iPhone 15 event didn’t reveal much about the Vision Pro headset\nSummary of Result 5: Apple introduced its Vision Pro headsets, which combine virtual reality, augmented reality, and connectivity to devices like phones and computers. However, the headsets will not be available for sale until early next year. Information about the headsets is limited, and their pricing is expected to be around $3,500 and up. Apple has yet to provide details on how the headsets will be used and their specific features.\nNote: These titles and summaries are based on the provided information and may not be entirely accurate. Additional details and context may be found in the full articles by following the provided URLs."
}
]
}
]
}
]
}
As you can see, developing AI-based applications does not have to be rocket science if you have the right tools at your disposal. Don’t hesitate to experiment, and bring up new transformative solutions fueled by AI and NLP.
Closing thoughts
We hope you enjoyed this journey from NLP basics and its impact on the web to some of the most widespread use cases where AI automation reduces manual tasks. At this point, you should know how to streamline the development process of content creation, competitor analysis, and Google results summarization tools with these AI-driven DataForSEO APIs:
Now we’re inviting you to unlock new dimensions of technological innovation and explore the potential of our intelligent algorithms yourself – try DataForSEO’s APIs for free.
