felmoltor / nvdparser

Access to NVD, download XML files, parse it and stores in sqlite3 database

Hi there 👋

• 🔭 I'm Felipe Molina, currently working at SensePost group of Orange Cyberdefense 🟧.
• ➕ Many of my personal repos are from the past, but some others are recent and can be found in the SensePost github.
• ⚡ Fun fact about me: I am not an AI!
• 📫 My Mastodon profile: Mastodon

nvdparser's Issues

TypeError: float() argument must be a string or a number

Exception not being handled properly

Traceback (most recent call last):
File "./nvdparser.py", line 278, in
size = float(col.text)
TypeError: float() argument must be a string or a number

Parsing speed is very low

Hi,

I am working on the following:

1. Use SQLalchemy instead of the standard SQL API
2. decompress the XML file and then parse instead of reading from tar.gz files directly
3. Use multi-threading to speed-up database writes (Hopefully increase performance)

Please do let me know if the speed for creating a database from scratch takes a lot of time. It has taken a number of hours in my instance.

IOError: Not a gzipped file

IndexError: list index out of range

Hello, thank you for your code.
I can not understand the reason (

Traceback (most recent call last):
   File "nvdparser.py", line 260, in <module>
     feedtable = html.xpath ("// table [@ class = 'xml-feed-table']") [0]
IndexError: list index out of range

I looked at the page code, like there are no errors
Can you help figure it out?