jeroennijhof / openufp Goto Github PK

Sorry, I feel like we're pushing this app to new limits ;-)

We're getting segfault errors when using caching -- doesn't appear right way, but after running for a while we do see it:

Apr 20 12:19:17 somehost kernel: [2693620.635442] openufp[28038]: segfault at 8 ip 00007f9ed5a1cf28 sp 00007fffb56d4060 error 4 in libdb-5.1.so[7f9ed59dd000+16c000]

Here's some valgrind debug output:

==990== Conditional jump or move depends on uninitialised value(s)
==990== at 0x4E6E004: __bam_stkrel (in /usr/lib/x86_64-linux-gnu/libdb-5.1.so)
==990== by 0x4E5ED3B: ??? (in /usr/lib/x86_64-linux-gnu/libdb-5.1.so)
==990== by 0x4EF6418: __dbc_iput (in /usr/lib/x86_64-linux-gnu/libdb-5.1.so)
==990== by 0x4EF401F: __db_put (in /usr/lib/x86_64-linux-gnu/libdb-5.1.so)
==990== by 0x4F05D8A: __db_put_pp (in /usr/lib/x86_64-linux-gnu/libdb-5.1.so)
==990== by 0x401FC5: add_cache (in /usr/sbin/openufp)
==990== by 0x4019B3: main (in /usr/sbin/openufp)
==990==
==990== Use of uninitialised value of size 8
==990== at 0x4E71F28: __bam_split (in /usr/lib/x86_64-linux-gnu/libdb-5.1.so)
==990== by 0x4E5ECAC: ??? (in /usr/lib/x86_64-linux-gnu/libdb-5.1.so)
==990== by 0x4EF6418: __dbc_iput (in /usr/lib/x86_64-linux-gnu/libdb-5.1.so)
==990== by 0x4EF401F: __db_put (in /usr/lib/x86_64-linux-gnu/libdb-5.1.so)
==990== by 0x4F05D8A: __db_put_pp (in /usr/lib/x86_64-linux-gnu/libdb-5.1.so)
==990== by 0x401FC5: add_cache (in /usr/sbin/openufp)
==990== by 0x4019B3: main (in /usr/sbin/openufp)
==990==
==990== Use of uninitialised value of size 8
==990== at 0x4E71048: __bam_pinsert (in /usr/lib/x86_64-linux-gnu/libdb-5.1.so)
==990== by 0x4E72365: __bam_split (in /usr/lib/x86_64-linux-gnu/libdb-5.1.so)
==990== by 0x4E5ECAC: ??? (in /usr/lib/x86_64-linux-gnu/libdb-5.1.so)
==990== by 0x4EF6418: __dbc_iput (in /usr/lib/x86_64-linux-gnu/libdb-5.1.so)
==990== by 0x4EF401F: __db_put (in /usr/lib/x86_64-linux-gnu/libdb-5.1.so)
==990== by 0x4F05D8A: __db_put_pp (in /usr/lib/x86_64-linux-gnu/libdb-5.1.so)
==990== by 0x401FC5: add_cache (in /usr/sbin/openufp)
==990== by 0x4019B3: main (in /usr/sbin/openufp)
==990==
==990== Use of uninitialised value of size 8
==990== at 0x4E71067: __bam_pinsert (in /usr/lib/x86_64-linux-gnu/libdb-5.1.so)
==990== by 0x4E72365: __bam_split (in /usr/lib/x86_64-linux-gnu/libdb-5.1.so)
==990== by 0x4E5ECAC: ??? (in /usr/lib/x86_64-linux-gnu/libdb-5.1.so)
==990== by 0x4EF6418: __dbc_iput (in /usr/lib/x86_64-linux-gnu/libdb-5.1.so)
==990== by 0x4EF401F: __db_put (in /usr/lib/x86_64-linux-gnu/libdb-5.1.so)
==990== by 0x4F05D8A: __db_put_pp (in /usr/lib/x86_64-linux-gnu/libdb-5.1.so)
==990== by 0x401FC5: add_cache (in /usr/sbin/openufp)
==990== by 0x4019B3: main (in /usr/sbin/openufp)
==990==
==990== Use of uninitialised value of size 8
==990== at 0x4E71048: __bam_pinsert (in /usr/lib/x86_64-linux-gnu/libdb-5.1.so)
==990== by 0x4E72422: __bam_split (in /usr/lib/x86_64-linux-gnu/libdb-5.1.so)
==990== by 0x4E5ECAC: ??? (in /usr/lib/x86_64-linux-gnu/libdb-5.1.so)
==990== by 0x4EF6418: __dbc_iput (in /usr/lib/x86_64-linux-gnu/libdb-5.1.so)
==990== by 0x4EF401F: __db_put (in /usr/lib/x86_64-linux-gnu/libdb-5.1.so)
==990== by 0x4F05D8A: __db_put_pp (in /usr/lib/x86_64-linux-gnu/libdb-5.1.so)
==990== by 0x401FC5: add_cache (in /usr/sbin/openufp)
==990== by 0x4019B3: main (in /usr/sbin/openufp)
==990==
==990== Use of uninitialised value of size 8
==990== at 0x4E71067: __bam_pinsert (in /usr/lib/x86_64-linux-gnu/libdb-5.1.so)
==990== by 0x4E72422: __bam_split (in /usr/lib/x86_64-linux-gnu/libdb-5.1.so)
==990== by 0x4E5ECAC: ??? (in /usr/lib/x86_64-linux-gnu/libdb-5.1.so)
==990== by 0x4EF6418: __dbc_iput (in /usr/lib/x86_64-linux-gnu/libdb-5.1.so)
==990== by 0x4EF401F: __db_put (in /usr/lib/x86_64-linux-gnu/libdb-5.1.so)
==990== by 0x4F05D8A: __db_put_pp (in /usr/lib/x86_64-linux-gnu/libdb-5.1.so)
==990== by 0x401FC5: add_cache (in /usr/sbin/openufp)
==990== by 0x4019B3: main (in /usr/sbin/openufp)
==990==
==990== Use of uninitialised value of size 8
==990== at 0x4F00329: __db_pitem_nolog (in /usr/lib/x86_64-linux-gnu/libdb-5.1.so)
==990== by 0x4E70CD5: __bam_pinsert (in /usr/lib/x86_64-linux-gnu/libdb-5.1.so)
==990== by 0x4E72422: __bam_split (in /usr/lib/x86_64-linux-gnu/libdb-5.1.so)
==990== by 0x4E5ECAC: ??? (in /usr/lib/x86_64-linux-gnu/libdb-5.1.so)
==990== by 0x4EF6418: __dbc_iput (in /usr/lib/x86_64-linux-gnu/libdb-5.1.so)
==990== by 0x4EF401F: __db_put (in /usr/lib/x86_64-linux-gnu/libdb-5.1.so)
==990== by 0x4F05D8A: __db_put_pp (in /usr/lib/x86_64-linux-gnu/libdb-5.1.so)
==990== by 0x401FC5: add_cache (in /usr/sbin/openufp)
==990== by 0x4019B3: main (in /usr/sbin/openufp)
==990==
==990== Use of uninitialised value of size 8
==990== at 0x4F0035C: __db_pitem_nolog (in /usr/lib/x86_64-linux-gnu/libdb-5.1.so)
==990== by 0x4E70CD5: __bam_pinsert (in /usr/lib/x86_64-linux-gnu/libdb-5.1.so)
==990== by 0x4E72422: __bam_split (in /usr/lib/x86_64-linux-gnu/libdb-5.1.so)
==990== by 0x4E5ECAC: ??? (in /usr/lib/x86_64-linux-gnu/libdb-5.1.so)
==990== by 0x4EF6418: __dbc_iput (in /usr/lib/x86_64-linux-gnu/libdb-5.1.so)
==990== by 0x4EF401F: __db_put (in /usr/lib/x86_64-linux-gnu/libdb-5.1.so)
==990== by 0x4F05D8A: __db_put_pp (in /usr/lib/x86_64-linux-gnu/libdb-5.1.so)
==990== by 0x401FC5: add_cache (in /usr/sbin/openufp)
==990== by 0x4019B3: main (in /usr/sbin/openufp)
==990==
==990== Conditional jump or move depends on uninitialised value(s)
==990== at 0x4F003DA: __db_pitem_nolog (in /usr/lib/x86_64-linux-gnu/libdb-5.1.so)
==990== by 0x4E70CD5: __bam_pinsert (in /usr/lib/x86_64-linux-gnu/libdb-5.1.so)
==990== by 0x4E72422: __bam_split (in /usr/lib/x86_64-linux-gnu/libdb-5.1.so)
==990== by 0x4E5ECAC: ??? (in /usr/lib/x86_64-linux-gnu/libdb-5.1.so)
==990== by 0x4EF6418: __dbc_iput (in /usr/lib/x86_64-linux-gnu/libdb-5.1.so)
==990== by 0x4EF401F: __db_put (in /usr/lib/x86_64-linux-gnu/libdb-5.1.so)
==990== by 0x4F05D8A: __db_put_pp (in /usr/lib/x86_64-linux-gnu/libdb-5.1.so)
==990== by 0x401FC5: add_cache (in /usr/sbin/openufp)
==990== by 0x4019B3: main (in /usr/sbin/openufp)
==990==
==990== Conditional jump or move depends on uninitialised value(s)
==990== at 0x4C2CD2A: memcpy@GLIBC_2.2.5 (in /usr/lib/valgrind/vgpreload_memcheck-amd64-linux.so)
==990== by 0x4F00401: __db_pitem_nolog (in /usr/lib/x86_64-linux-gnu/libdb-5.1.so)
==990== by 0x4E70CD5: __bam_pinsert (in /usr/lib/x86_64-linux-gnu/libdb-5.1.so)
==990== by 0x4E72422: __bam_split (in /usr/lib/x86_64-linux-gnu/libdb-5.1.so)
==990== by 0x4E5ECAC: ??? (in /usr/lib/x86_64-linux-gnu/libdb-5.1.so)
==990== by 0x4EF6418: __dbc_iput (in /usr/lib/x86_64-linux-gnu/libdb-5.1.so)
==990== by 0x4EF401F: __db_put (in /usr/lib/x86_64-linux-gnu/libdb-5.1.so)
==990== by 0x4F05D8A: __db_put_pp (in /usr/lib/x86_64-linux-gnu/libdb-5.1.so)
==990== by 0x401FC5: add_cache (in /usr/sbin/openufp)
==990== by 0x4019B3: main (in /usr/sbin/openufp)
==990==
==990== Conditional jump or move depends on uninitialised value(s)
==990== at 0x4C2CD33: memcpy@GLIBC_2.2.5 (in /usr/lib/valgrind/vgpreload_memcheck-amd64-linux.so)
==990== by 0x4F00401: __db_pitem_nolog (in /usr/lib/x86_64-linux-gnu/libdb-5.1.so)
==990== by 0x4E70CD5: __bam_pinsert (in /usr/lib/x86_64-linux-gnu/libdb-5.1.so)
==990== by 0x4E72422: __bam_split (in /usr/lib/x86_64-linux-gnu/libdb-5.1.so)
==990== by 0x4E5ECAC: ??? (in /usr/lib/x86_64-linux-gnu/libdb-5.1.so)
==990== by 0x4EF6418: __dbc_iput (in /usr/lib/x86_64-linux-gnu/libdb-5.1.so)
==990== by 0x4EF401F: __db_put (in /usr/lib/x86_64-linux-gnu/libdb-5.1.so)
==990== by 0x4F05D8A: __db_put_pp (in /usr/lib/x86_64-linux-gnu/libdb-5.1.so)
==990== by 0x401FC5: add_cache (in /usr/sbin/openufp)
==990== by 0x4019B3: main (in /usr/sbin/openufp)
==990==
==990== Conditional jump or move depends on uninitialised value(s)
==990== at 0x4C2CE18: memcpy@GLIBC_2.2.5 (in /usr/lib/valgrind/vgpreload_memcheck-amd64-linux.so)
==990== by 0x4F00401: __db_pitem_nolog (in /usr/lib/x86_64-linux-gnu/libdb-5.1.so)
==990== by 0x4E70CD5: __bam_pinsert (in /usr/lib/x86_64-linux-gnu/libdb-5.1.so)
==990== by 0x4E72422: __bam_split (in /usr/lib/x86_64-linux-gnu/libdb-5.1.so)
==990== by 0x4E5ECAC: ??? (in /usr/lib/x86_64-linux-gnu/libdb-5.1.so)
==990== by 0x4EF6418: __dbc_iput (in /usr/lib/x86_64-linux-gnu/libdb-5.1.so)
==990== by 0x4EF401F: __db_put (in /usr/lib/x86_64-linux-gnu/libdb-5.1.so)
==990== by 0x4F05D8A: __db_put_pp (in /usr/lib/x86_64-linux-gnu/libdb-5.1.so)
==990== by 0x401FC5: add_cache (in /usr/sbin/openufp)
==990== by 0x4019B3: main (in /usr/sbin/openufp)
==990==
==990== Conditional jump or move depends on uninitialised value(s)
==990== at 0x4C2CE2A: memcpy@GLIBC_2.2.5 (in /usr/lib/valgrind/vgpreload_memcheck-amd64-linux.so)
==990== by 0x4F00401: __db_pitem_nolog (in /usr/lib/x86_64-linux-gnu/libdb-5.1.so)
==990== by 0x4E70CD5: __bam_pinsert (in /usr/lib/x86_64-linux-gnu/libdb-5.1.so)
==990== by 0x4E72422: __bam_split (in /usr/lib/x86_64-linux-gnu/libdb-5.1.so)
==990== by 0x4E5ECAC: ??? (in /usr/lib/x86_64-linux-gnu/libdb-5.1.so)
==990== by 0x4EF6418: __dbc_iput (in /usr/lib/x86_64-linux-gnu/libdb-5.1.so)
==990== by 0x4EF401F: __db_put (in /usr/lib/x86_64-linux-gnu/libdb-5.1.so)
==990== by 0x4F05D8A: __db_put_pp (in /usr/lib/x86_64-linux-gnu/libdb-5.1.so)
==990== by 0x401FC5: add_cache (in /usr/sbin/openufp)
==990== by 0x4019B3: main (in /usr/sbin/openufp)
==990==
==990== Conditional jump or move depends on uninitialised value(s)
==990== at 0x4C2CEAE: memcpy@GLIBC_2.2.5 (in /usr/lib/valgrind/vgpreload_memcheck-amd64-linux.so)
==990== by 0x4F00401: __db_pitem_nolog (in /usr/lib/x86_64-linux-gnu/libdb-5.1.so)
==990== by 0x4E70CD5: __bam_pinsert (in /usr/lib/x86_64-linux-gnu/libdb-5.1.so)
==990== by 0x4E72422: __bam_split (in /usr/lib/x86_64-linux-gnu/libdb-5.1.so)
==990== by 0x4E5ECAC: ??? (in /usr/lib/x86_64-linux-gnu/libdb-5.1.so)
==990== by 0x4EF6418: __dbc_iput (in /usr/lib/x86_64-linux-gnu/libdb-5.1.so)
==990== by 0x4EF401F: __db_put (in /usr/lib/x86_64-linux-gnu/libdb-5.1.so)
==990== by 0x4F05D8A: __db_put_pp (in /usr/lib/x86_64-linux-gnu/libdb-5.1.so)
==990== by 0x401FC5: add_cache (in /usr/sbin/openufp)
==990== by 0x4019B3: main (in /usr/sbin/openufp)
==990==
==990== Conditional jump or move depends on uninitialised value(s)
==990== at 0x4C2CEB4: memcpy@GLIBC_2.2.5 (in /usr/lib/valgrind/vgpreload_memcheck-amd64-linux.so)
==990== by 0x4F00401: __db_pitem_nolog (in /usr/lib/x86_64-linux-gnu/libdb-5.1.so)
==990== by 0x4E70CD5: __bam_pinsert (in /usr/lib/x86_64-linux-gnu/libdb-5.1.so)
==990== by 0x4E72422: __bam_split (in /usr/lib/x86_64-linux-gnu/libdb-5.1.so)
==990== by 0x4E5ECAC: ??? (in /usr/lib/x86_64-linux-gnu/libdb-5.1.so)
==990== by 0x4EF6418: __dbc_iput (in /usr/lib/x86_64-linux-gnu/libdb-5.1.so)
==990== by 0x4EF401F: __db_put (in /usr/lib/x86_64-linux-gnu/libdb-5.1.so)
==990== by 0x4F05D8A: __db_put_pp (in /usr/lib/x86_64-linux-gnu/libdb-5.1.so)
==990== by 0x401FC5: add_cache (in /usr/sbin/openufp)
==990== by 0x4019B3: main (in /usr/sbin/openufp)
==990==
==990== Use of uninitialised value of size 8
==990== at 0x4C2CEC8: memcpy@GLIBC_2.2.5 (in /usr/lib/valgrind/vgpreload_memcheck-amd64-linux.so)
==990== by 0x4F00401: __db_pitem_nolog (in /usr/lib/x86_64-linux-gnu/libdb-5.1.so)
==990== by 0x4E70CD5: __bam_pinsert (in /usr/lib/x86_64-linux-gnu/libdb-5.1.so)
==990== by 0x4E72422: __bam_split (in /usr/lib/x86_64-linux-gnu/libdb-5.1.so)
==990== by 0x4E5ECAC: ??? (in /usr/lib/x86_64-linux-gnu/libdb-5.1.so)
==990== by 0x4EF6418: __dbc_iput (in /usr/lib/x86_64-linux-gnu/libdb-5.1.so)
==990== by 0x4EF401F: __db_put (in /usr/lib/x86_64-linux-gnu/libdb-5.1.so)
==990== by 0x4F05D8A: __db_put_pp (in /usr/lib/x86_64-linux-gnu/libdb-5.1.so)
==990== by 0x401FC5: add_cache (in /usr/sbin/openufp)
==990== by 0x4019B3: main (in /usr/sbin/openufp)
==990==
==990== Use of uninitialised value of size 8
==990== at 0x4C2CECE: memcpy@GLIBC_2.2.5 (in /usr/lib/valgrind/vgpreload_memcheck-amd64-linux.so)
==990== by 0x4F00401: __db_pitem_nolog (in /usr/lib/x86_64-linux-gnu/libdb-5.1.so)
==990== by 0x4E70CD5: __bam_pinsert (in /usr/lib/x86_64-linux-gnu/libdb-5.1.so)
==990== by 0x4E72422: __bam_split (in /usr/lib/x86_64-linux-gnu/libdb-5.1.so)
==990== by 0x4E5ECAC: ??? (in /usr/lib/x86_64-linux-gnu/libdb-5.1.so)
==990== by 0x4EF6418: __dbc_iput (in /usr/lib/x86_64-linux-gnu/libdb-5.1.so)
==990== by 0x4EF401F: __db_put (in /usr/lib/x86_64-linux-gnu/libdb-5.1.so)
==990== by 0x4F05D8A: __db_put_pp (in /usr/lib/x86_64-linux-gnu/libdb-5.1.so)
==990== by 0x401FC5: add_cache (in /usr/sbin/openufp)
==990== by 0x4019B3: main (in /usr/sbin/openufp)
==990==
==990==
==990== Process terminating with default action of signal 11 (SIGSEGV)
==990== Bad permissions for mapped region at address 0x4F66CDC
==990== at 0x4C2CECE: memcpy@GLIBC_2.2.5 (in /usr/lib/valgrind/vgpreload_memcheck-amd64-linux.so)
==990== by 0x4F00401: __db_pitem_nolog (in /usr/lib/x86_64-linux-gnu/libdb-5.1.so)
==990== by 0x4E70CD5: __bam_pinsert (in /usr/lib/x86_64-linux-gnu/libdb-5.1.so)
==990== by 0x4E72422: __bam_split (in /usr/lib/x86_64-linux-gnu/libdb-5.1.so)
==990== by 0x4E5ECAC: ??? (in /usr/lib/x86_64-linux-gnu/libdb-5.1.so)
==990== by 0x4EF6418: __dbc_iput (in /usr/lib/x86_64-linux-gnu/libdb-5.1.so)
==990== by 0x4EF401F: __db_put (in /usr/lib/x86_64-linux-gnu/libdb-5.1.so)
==990== by 0x4F05D8A: __db_put_pp (in /usr/lib/x86_64-linux-gnu/libdb-5.1.so)
==990== by 0x401FC5: add_cache (in /usr/sbin/openufp)
==990== by 0x4019B3: main (in /usr/sbin/openufp)
==990==
==990== HEAP SUMMARY:
==990== in use at exit: 244,683 bytes in 45 blocks
==990== total heap usage: 177 allocs, 132 frees, 594,100 bytes allocated
==990==
==990== LEAK SUMMARY:
==990== definitely lost: 8,488 bytes in 3 blocks
==990== indirectly lost: 0 bytes in 0 blocks
==990== possibly lost: 220,972 bytes in 14 blocks
==990== still reachable: 15,223 bytes in 28 blocks
==990== suppressed: 0 bytes in 0 blocks
==990== Rerun with --leak-check=full to see details of leaked memory
==990==
==990== For counts of detected and suppressed errors, rerun with: -v
==990== Use --track-origins=yes to see where uninitialised values come from
==990== ERROR SUMMARY: 17 errors from 17 contexts (suppressed: 2 from 2)

Not sure if this has been noticed or reported, but I've been seeing some strange behavior (e.g. block pages for other users' URL requests being presented to users who were not even browsing the site for which a block page was delivered). It doesn't seem to matter what protocol is used, n2h2 or websense (using tcp 1 or tcp 4 on the ASA) ... I'm using the squidGuard backend and it receives the URL request from the ASA just fine, parses it, and even provides the correct allow/deny response, but it seems like some sort of identifier/serial is getting mixed up when openUFP responds to the ASA. Have you seen this behavior? Maybe the request or response structures have changed?

Thanks for any help, and I'd be happy to provide some packet captures if it helps,

JR

I've noticed that openufp works well acting as websense server frontend to process HTTP onto the Squid Proxy.

HTTPS however returns a 'request type not known, closing connecion'. I envisage this has something to do with Squid processing HTTP on one listening port and HTTPS on another.

i.e.
using HTTP
client:
curl http://www.google.com

server:
openufp openufp[20128]: received url request - Original URL: http://www.google.com/
openufp[20128]: proxy: result (HTTP/1.1 301 Moved Permanently#...

using HTTPS
client:
curl https://www.google.com

server:
openufp[20130]: request type not known, closing connecion.

Is it possible the different listeners could be integrated into openufp? i.e.
if http {url_check{proxip_ip proxy_port} elseif https { url_check{proxy_ip:proxy_port_https }