ChatGPT Scraping API

Input

                      import requests

prompt = "How to cook a pizza?"

def send_request_to_chatgpt(prompt_text='Hello'):
    response = requests.get(
        url='https://app.scrapingbee.com/api/v1',
        params={
            'api_key': 'API_KEY',
            'url': 'https://chatgpt.com/?model=gpt-4o',
            'stealth_proxy': 'true',
            'country_code': 'us',
            'js_scenario': '{"instructions":[{"wait_for":"#prompt-textarea > p"},{"evaluate":"document.querySelector(\'#prompt-textarea > p\').innerHTML = \'' + prompt_text + '\';"},{"wait":2000},{"evaluate":"document.querySelector(\'#composer-submit-button\').click();"},{"wait":15000},{"wait_for":"button[data-testid=good-response-turn-action-button]"}]}',
            'extract_rules': '{"AI Response":"article[data-testid=conversation-turn-2] > div"}'
        },
    )
    print('Response HTTP Status Code: ', response.status_code)
    print(response.json())

send_request_to_chatgpt(prompt)

                    

Output

                      Response HTTP Status Code: 200
{
  'AI Response': 'Cooking a pizza can be as simple or as gourmet as you like! Here's a basic step-by-step method for making a classic homemade pizza using store-bought or homemade dough: 🍕 Basic Pizza Recipe Ingredients: Pizza dough (store-bought or homemade) Tomato sauce (pizza sauce or marinara) Mozzarella cheese, shredded Toppings (pepperoni, vegetables, olives, mushrooms, etc.) Olive oil Flour or cornmeal (for dusting) 🔥 Instructions: Preheat the oven Set your oven to 475°F (245°C) and place a pizza stone or baking sheet inside to heat up. Prepare the dough Roll out the dough on a floured surface to your desired thickness (thin or thick crust). Transfer the dough to a piece of parchment paper or a floured pizza peel. Add the sauce Spread a thin layer of tomato sauce over the dough, leaving a small border around the edges. Add cheese and toppings Sprinkle shredded mozzarella evenly. Add any toppings you like—be careful not to overload, or the pizza can get soggy. Bake the pizza Slide the pizza (with parchment if needed) onto the preheated stone or baking sheet. Bake for 10–15 minutes, or until the crust is golden and cheese is bubbly and slightly browned. Finish and serve Remove from the oven, drizzle with a little olive oil or sprinkle fresh basil if desired. Let it cool for a minute, slice, and enjoy! Would you like a quick dough recipe too, or tips for different styles (e.g., Neapolitan, deep dish, pan pizza)?'
}