Access to RawHTML from selectors about toapi

[howie6879]

Hi @ahetawal-p :

There is a solution here:

# script: example/search.py

class Bing(Item):
    __name__ = 'bing'
    __base_url__ = 'https://www.bing.com'

    url = Css('h2 a', attr='href')
    title = Css('h2 a')

    def clean_url(self, url):
        if isinstance(url, list):
            url = url[0].get('href')
        return url
# get access to the raw HTML 
class Bing(Item):
    __name__ = 'bing'
    __base_url__ = 'https://www.bing.com'
    
    url = Css('h2 a', attr='html')
    title = Css('h2 a')

    def clean_url(self, url):
        from lxml.html import tostring
        html = tostring(url[0])
        # do something here ...
        url = ...
        return url

[ahetawal-p]

Thanks a lot @howie6879. I was able to get my rawHTML based on your solutions.
Thank you again !!