Coder Social home page Coder Social logo

domain_exporter's Introduction

Hi there 👋

I'm Carlos, I write and operate software for a living.

👨‍💻 Repositories I created recently

❤️ Recent Sponsors

Many thanks everyone! 🙏

⛏️ What I've been working on

📚 Books I'm reading

You might want to check out my books wishlist and my literal.club profile as well.

📄 Latest blog posts

domain_exporter's People

Contributors

agrrh avatar caarlos0 avatar czerasz avatar dependabot-preview[bot] avatar dependabot[bot] avatar diogonicoleti avatar erethon avatar filipc avatar guillaumevillemont avatar hanbaga avatar igordiachkov avatar itcrow avatar juhovan avatar kasep avatar mrnonz avatar naeimehmhm avatar ozarklake avatar peterhoeg avatar q7r avatar renovate[bot] avatar resonant-riches avatar s4mur4i avatar sapphi-red avatar serhatcetinkaya avatar skob avatar tmatias avatar vorobiovv avatar vucong2409 avatar whi-tw avatar zifter avatar

Stargazers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

Watchers

 avatar  avatar  avatar  avatar  avatar  avatar

domain_exporter's Issues

validation for .co.kr

Is it possible to cover the validation for this domains.
ex: google.co.kr
Expiry Date format: 2020. 07. 28

i\o timeout

error to scrape .online,.siite, .best tld:
level=error msg="failed to probe tuttenotizie.online: dial tcp [2a04:2b00:119::c:54]:43: i/o timeout" source="domain.go:65"

domain_exporter return i/o timeout error for some gTLD

Hi @caarlos0, i've faced an issue with some gTLD zones.

When i try to check this zones:

.xyz
.space
.site
.online
.website
.tech
.online
.pw

they all failed with i/o timeout error, like this one dial tcp 119.252.181.42:43: i/o timeout

Also i saw that the f.e. evenstranger.pw at domainr (https://domainr.com/evenstranger.pw?q=evenstranger.pw) won't show us domain expiration date (or any whois data Oo), but whois command return expiration date:

whois evenstranger.pw | grep "Registry Expiry Date"
Registry Expiry Date: 2018-10-23T23:59:59.0Z

linux/arm/v8 support

Please add linux/arm/v8 images to docker hub.
I'm trying to pull it from Raspbian 11 / Raspberry Pi OS.

Dependabot can't resolve your Go dependency files

Dependabot can't resolve your Go dependency files.

As a result, Dependabot couldn't update your dependencies.

The error Dependabot encountered was:

github.com/caarlos0/domain_exporter/internal/client: cannot find module providing package github.com/caarlos0/domain_exporter/internal/client
	github.com/caarlos0/domain_exporter/internal/collector: cannot find module providing package github.com/caarlos0/domain_exporter/internal/collector
	github.com/caarlos0/domain_exporter/internal/rdap: cannot find module providing package github.com/caarlos0/domain_exporter/internal/rdap
	github.com/caarlos0/domain_exporter/internal/whois: cannot find module providing package github.com/caarlos0/domain_exporter/internal/whois

If you think the above is an error on Dependabot's side please don't hesitate to get in touch - we'll do whatever we can to fix it.

View the update logs.

dial tcp: lookup domain on 127.0.0.11:53: no such host

Hello,

I've tried to use yours exporter inside the docker under docker-compose, but it returns the same answer for all domains.
Like:
Get http://domain:9222/probe?target=watchub.pw: dial tcp: lookup domain on 127.0.0.11:53: no such host

Also, I've ran ping comand inside the container, and domain name resolves fine.

Could you advice, what I do wrong ? And domain can be registered but don't contain any DNS records.

Thank you.

[Docs] Add Example Grafana Dashboard ID / Json

When searching for a default dashboard to get jumpstarted for this exporter, I only see 2 outdated Grafana dashboards:

Either adding a dashboard & maintaining it on Grafana's community page OR adding the dashboard json to this repo would enable users to clone this repo and get started much faster

Need to reduce request rate

I need to monitor the status of quite a large number of domains, and therefore domain_exporter makes a lot of requests to the WHOIS server, which entails blocking:

domain-exporter  | 11:07AM ERR failed to probe {xxxxxx.ru } error="could not parse whois response:
You are not allowed to connect due to excessive querying of the WHOIS database.
See https://tcinet.ru/documents/whois_ru_rf.pdf (in Russian)
https://tcinet.ru/documents/whois_su.pdf (in Russian) for details.

Is it possible to limit domain_exporter to the number of requests per unit of time so that it does not overload the WHOIS service?

Dependabot can't resolve your Go dependency files

Dependabot can't resolve your Go dependency files.

As a result, Dependabot couldn't update your dependencies.

The error Dependabot encountered was:

github.com/caarlos0/domain_exporter/internal/client: cannot find module providing package github.com/caarlos0/domain_exporter/internal/client
github.com/caarlos0/domain_exporter imports
	github.com/caarlos0/domain_exporter/internal/collector: cannot find module providing package github.com/caarlos0/domain_exporter/internal/collector
github.com/caarlos0/domain_exporter imports
	github.com/caarlos0/domain_exporter/internal/rdap: cannot find module providing package github.com/caarlos0/domain_exporter/internal/rdap
github.com/caarlos0/domain_exporter imports
	github.com/caarlos0/domain_exporter/internal/whois: cannot find module providing package github.com/caarlos0/domain_exporter/internal/whois

If you think the above is an error on Dependabot's side please don't hesitate to get in touch - we'll do whatever we can to fix it.

View the update logs.

.name and .cn can not parse

whois is ok:

# whois google.name
[Querying whois.nic.name]
[whois.nic.name]

Disclaimer: VeriSign, Inc. makes every effort to maintain the
completeness and accuracy of the Whois data, but cannot guarantee
that the results are error-free. Therefore, any data provided
through the Whois service are on an as is basis without any
warranties.
BY USING THE WHOIS SERVICE AND THE DATA CONTAINED
HEREIN OR IN ANY REPORT GENERATED WITH RESPECT THERETO, IT IS
ACCEPTED THAT VERISIGN, INC. IS NOT LIABLE FOR
ANY DAMAGES OF ANY KIND ARISING OUT OF, OR IN CONNECTION WITH, THE
REPORT OR THE INFORMATION PROVIDED BY THE WHOIS SERVICE, NOR
OMISSIONS OR MISSING INFORMATION. THE RESULTS OF ANY WHOIS REPORT OR
INFORMATION PROVIDED BY THE WHOIS SERVICE CANNOT BE RELIED UPON IN
CONTEMPLATION OF LEGAL PROCEEDINGS WITHOUT FURTHER VERIFICATION, NOR
DO SUCH RESULTS CONSTITUTE A LEGAL OPINION. Acceptance of the
results of the Whois constitutes acceptance of these terms,
conditions and limitations. Whois data may be requested only for
lawful purposes, in particular, to protect legal rights and
obligations. Illegitimate uses of Whois data include, but are not
limited to, unsolicited email, data mining, direct marketing or any
other improper purpose. Any request made for Whois data will be
documented by VeriSign, Inc. but will not be used for any commercial purpose whatsoever.

 ****

   Registry Domain ID: 134538139_DOMAIN_NAME-VRSN
   Domain Name: GOOGLE.NAME
   Registrar: MarkMonitor Inc.
   Registrar IANA ID: 292
   Registrar Abuse Contact Email: [email protected]
   Registrar Abuse Contact Phone: +1.2083895740
   Domain Status: serverDeleteProhibited https://icann.org/epp#serverDeleteProhibited
   Domain Status: serverTransferProhibited https://icann.org/epp#serverTransferProhibited
   Domain Status: serverUpdateProhibited https://icann.org/epp#serverUpdateProhibited
   Registry Registrant ID: 14447011_CONTACT_NAME-VRSN
   Registry Admin ID: 14447011_CONTACT_NAME-VRSN
   Registry Tech ID: 14447011_CONTACT_NAME-VRSN
   Registry Billing ID: 14447011_CONTACT_NAME-VRSN
   Name Server: NS1.GOOGLE.COM
   Name Server ID: 69815439_HOST_NAME-VRSN
   Name Server: NS2.GOOGLE.COM
   Name Server ID: 69815440_HOST_NAME-VRSN
   Name Server: NS3.GOOGLE.COM
   Name Server ID: 69815441_HOST_NAME-VRSN
   Name Server: NS4.GOOGLE.COM
   Name Server ID: 69815442_HOST_NAME-VRSN
   Created On: 2010-06-17T00:46:09Z
   Expires On: 2019-06-17T00:46:12Z
   Updated On: 2018-05-16T09:33:11Z
   URL of the ICANN Whois Inaccuracy Complaint Form: https://www.icann.org/wicf/

>>> Last update of whois database: 2018-07-13T06:05:03Z <<<

For more information on Whois status codes, please visit https://icann.org/epp

To request access to data listed as “Redacted” or “Redacted for Privacy” in the
above WHOIS result, please contact Customer Service at [email protected]
# whois google.cn
[Querying whois.cnnic.cn]
[whois.cnnic.cn]
Domain Name: google.cn
ROID: 20030311s10001s00033735-cn
Domain Status: clientDeleteProhibited
Domain Status: serverDeleteProhibited
Domain Status: clientUpdateProhibited
Domain Status: serverUpdateProhibited
Domain Status: clientTransferProhibited
Domain Status: serverTransferProhibited
Registrant ID: mark-135742
Registrant: Google Inc.
Registrant Contact Email: [email protected]
Sponsoring Registrar: MarkMonitor Inc.
Name Server: ns1.google.com
Name Server: ns2.google.com
Name Server: ns3.google.com
Name Server: ns4.google.com
Registration Time: 2003-03-17 12:20:05
Expiration Time: 2019-03-17 12:48:36
DNSSEC: unsigned

Dependabot can't resolve your Go dependency files

Dependabot can't resolve your Go dependency files.

As a result, Dependabot couldn't update your dependencies.

The error Dependabot encountered was:

github.com/caarlos0/domain_exporter/internal/client: cannot find module providing package github.com/caarlos0/domain_exporter/internal/client
	github.com/caarlos0/domain_exporter/internal/collector: cannot find module providing package github.com/caarlos0/domain_exporter/internal/collector
	github.com/caarlos0/domain_exporter/internal/rdap: cannot find module providing package github.com/caarlos0/domain_exporter/internal/rdap
	github.com/caarlos0/domain_exporter/internal/whois: cannot find module providing package github.com/caarlos0/domain_exporter/internal/whois

If you think the above is an error on Dependabot's side please don't hesitate to get in touch - we'll do whatever we can to fix it.

View the update logs.

.ai TLD not show expiry date

I try to use this domain_exporter with pork.ai domain and got -1 of expiry date then I try to whois command and got

Domain Name: pork.ai
Registry Domain ID: 1009534_nic_ai
Registry WHOIS Server: whois.nic.ai
Creation Date: 2020-07-06T04:12:27.299Z
Registrar: Porkbun LLC
Registrar Abuse Contact Email: [email protected]
Registrar Abuse Contact Phone: +1.8557075286
Registry RegistrantID: 7n07g-MwCCJ
RegistrantName: Whois Privacy
RegistrantOrganization: Private by Design, LLC
RegistrantStreet: 500 Westover Dr #9816
RegistrantCity: Sanford
RegistrantState/Province: NC
RegistrantPostal Code: 27330
RegistrantCountry: US
RegistrantPhone: +1.9712666028
RegistrantEmail: [email protected]
Registry AdminID: JGzt9-N8xII
AdminName: Whois Privacy
AdminOrganization: Private by Design, LLC
AdminStreet: 500 Westover Dr #9816
AdminCity: Sanford
AdminState/Province: NC
AdminPostal Code: 27330
AdminCountry: US
AdminPhone: +1.9712666028
AdminEmail: [email protected]
Registry TechID: KoBC8-MC2QH
TechName: Whois Privacy
TechOrganization: Private by Design, LLC
TechStreet: 500 Westover Dr #9816
TechCity: Sanford
TechState/Province: NC
TechPostal Code: 27330
TechCountry: US
TechPhone: +1.9712666028
TechEmail: [email protected]
Registry BillingID: SIWTH-cZhpZ
BillingName: Whois Privacy
BillingOrganization: Private by Design, LLC
BillingStreet: 500 Westover Dr #9816
BillingCity: Sanford
BillingState/Province: NC
BillingPostal Code: 27330
BillingCountry: US
BillingPhone: +1.9712666028
BillingEmail: [email protected]
Name Server: ns1.parkingcrew.net
Name Server: ns2.parkingcrew.net
DNSSEC: unsigned

I don't know why that have every information except expiry date?

And After I try to whois with current registrar whois -h whois.porkbun.com pork.ai, here is my result

Domain Name: PORK.AI
Registry Domain ID: 1009534_nic_ai
Registrar WHOIS Server: whois.porkbun.com
Registrar URL: http://www.porkbun.com
Updated Date: 2022-06-30 03:31:09
Created Date: 2020-07-06 04:12:27
Registrar Registration Expiration Date: 2024-07-06 04:12:27
Registrar: Porkbun LLC
....

I got expiry date, so How can I solve this by domain_exporter service?

Thank you.

tld's not parsing correctly

I found some TLDs that have problems matching and parsing the expiry date. To help with debugging I wrote up a list of expiry date entries:

.sk: 
Valid Until:                  2020-09-08

.ro:
Expires On: 2021-09-18

.cz:
expire:       14.03.2020

.pt:
Data de expiração / Expiration Date (dd/mm/yyyy): 02/11/2019

.it:
Expire Date:        2019-08-06

Info page links are broken when running behind a proxy.

Hi.

I am trying to run this exporter behind a proxy. And links on the info page appear to be broken, e.g.:

Running on http://monitoring.foobar.com/domain_exporter
/metrics link looks like http://monitoring.foobar.com/metrics
but should be intstead:
http://monitoring.foobar.com/domain_exporter/metrics

At the same time blackbox exporter works fine.
From a page source I see what there is a difference in how links are generated in blackbox exporter and domain exporter:

<html>
    <head><title>Blackbox Exporter</title></head>
    <body>
    <h1>Blackbox Exporter</h1>
    <p><a href="probe?target=prometheus.io&module=http_2xx">Probe prometheus.io for http_2xx</a></p>
    <p><a href="probe?target=prometheus.io&module=http_2xx&debug=true">Debug probe prometheus.io for http_2xx</a></p>
    <p><a href="metrics">Metrics</a></p>
    <p><a href="config">Configuration</a></p>
    <h2>Recent Probes</h2>
      <html>
      <head><title>Domain Exporter</title></head>
      <body>
        <h1>Domain Exporter</h1>
        <p><a href="/metrics">Metrics</a></p>
        <p><a href="/probe?target=google.com">probe google.com</a></p>
      </body>
      </html>

Note metrics vs /metrics. So probably just removing that slash will work...

There's no way to add labels to individual domains

Hello maintainer,
Would it be possible to add labels to domain names?
That would help a lot for cases where different domains names are governed by different teams, or some domains are under specific registrars, etc.

domains:

  • name: reddit.com
    host: whois.godaddy.com
    labels:
    • label1: value1
    • label1L value2

Thanks

cache dns response

this does not change much.

with caching, the user can scrape every few seconds without triggering any rate limiting.
this may also help if the user has several domains to check :)

Not all domains expiry date is exported, but whois does show expiry info

Hello,
I want to use your project to monitor a list of corporate domains.
I put the exporter in place and made a grafana dashboard, everything looks good except for some domains.
There's no expiry data on some of the domains, but interestingly, linux whois retrns expiry data.
I assume this project also uses whois tool to extract dns domain data and I was wondering if you can fix it.

p.s. I understand that there're some domains that hide their data on purpose, but why would linux whois work then.
Im excited to see this tool in prod.
Thanks for looking into this.

.kz not show expiry date

HI. domain exporter does not show the expiration date for .kz. As I understand it, Domain expired is not processed

whois -h whois.megahost.kz megahost.kz

This Whois Server for the KZ domain zone is maintained by Megahost Kazakhstan LLC (https://megahost.kz).
Сервер информации о доменных именах в зоне KZ. Поддерживается ТОО "Мегахост Казахстан" (0.4463).

Domain Name............: MEGAHOST.KZ

Organization or Person Using Domain Name
Name...................: Megahost Kazakhstan  LLP
Organization Name......: Megahost Kazakhstan, LLP
Street Address.........: Uralsk, prospekt Evraziya, 59/3
City...................: Uralsk
State..................: Zapadno Kazakhstanskaya
Postal Code............: 090000
Country................: KZ

Administrative Contact/Agent
Contact ID.............: MEGAH-40466057
Name...................: Megahost Kazakhstan  LLP
Phone Number...........: +7.7273562797
Fax Number.............: +7.7112961197
Email Address..........: [email protected]

Nameserver in listed order
Primary server.........: ns1.megahost.kz
IPv4 address...........: 45.136.59.181

Secondary server.......: ns2.megahost.kz
IPv4 address...........: 95.59.26.195

Domain created.........: 2009-07-21 06:14:35 (GMT+0)
Transfer date..........: 2013-10-05 06:30:00 (GMT+0)
Last modified..........: 2023-01-26 17:18:57 (GMT+0)
Domain expired.........: 2025-07-21 06:14:35 (GMT+0)

Domain status..........: clientRenewProhibited

Registar created.......: GFX
Current Registar.......: MEGAHOST

compose

Aew Carlos Blz?!
É possivel rodar o domain_exporter com docker-compose?
Se tiver um exemplo como aplicar, agradeço.
Ainda estou estudando docker e prometheus :)

vlw, abraço.

Dependabot can't resolve your Go dependency files

Dependabot can't resolve your Go dependency files.

As a result, Dependabot couldn't update your dependencies.

The error Dependabot encountered was:

github.com/caarlos0/domain_exporter/internal/client: cannot find module providing package github.com/caarlos0/domain_exporter/internal/client
github.com/caarlos0/domain_exporter imports
	github.com/caarlos0/domain_exporter/internal/collector: cannot find module providing package github.com/caarlos0/domain_exporter/internal/collector
github.com/caarlos0/domain_exporter imports
	github.com/caarlos0/domain_exporter/internal/rdap: cannot find module providing package github.com/caarlos0/domain_exporter/internal/rdap
github.com/caarlos0/domain_exporter imports
	github.com/caarlos0/domain_exporter/internal/whois: cannot find module providing package github.com/caarlos0/domain_exporter/internal/whois
go: downloading github.com/patrickmn/go-cache v1.0.0
go: downloading github.com/alecthomas/kingpin v1.3.7

If you think the above is an error on Dependabot's side please don't hesitate to get in touch - we'll do whatever we can to fix it.

View the update logs.

Docker failed to start : no such file or directory

Last release introduced a bug on docker :

$ docker run --rm -p 9222:9222 caarlos0/domain_exporter                                                                                                                                                         
docker: Error response from daemon: failed to create shim task: OCI runtime create failed: runc create failed: unable to start container process: exec: "/usr/local/bin/domain_exporter": stat /usr/local/bin/domain_exporter: no such file or directory: unknown.

I haven't had the time to investigate but this should just be a docker build issue

Expiration not relevant to reality

Hello!
I tested on the domain w h i t e f o r t [dot] e u . And the expiration date turned out to be invalid. Which whois service is used "under the hood"?

.ai domains Unable to resolve

Unable to resolve domain names with the .ai suffix. I also used the “--config=domains.yaml” parameter, but it does not work. Can users directly specify the host to resolve in the whois command using the -h option?

I have set the following in prometheus.yml:

  - job_name: domain
    metrics_path: /probe
    relabel_configs:
      - source_labels: [__address__]
        target_label: __param_target
      - target_label: __address__
        replacement: localhost:9222 # domain_exporter address
    static_configs:
      - targets:
        - google.com

domains.yaml:

domains:
- baidu.com
- name: wondershare.ai
  host: whois.godaddy.com

The startup command is set as follows:

nohup domain_exporter --config=domains.yaml &

Am I using it incorrectly?

could not parse whois response

Hello, if i add any .eu domains, i receive this error -

11:50AM ERR failed to probe {l2.eu } error="could not parse whois response: "% The WHOIS service offered by EURid and the access to the records\n% in the EURid WHOIS database are provided for information purposes\n% only. It allows persons to check whether a specific domain name\n% is still available or not and to obtain information related to\n% the registration records of existing domain names.\n%\n% EURid cannot, under any circumstances, be held liable in case the\n% stored information would prove to be wrong, incomplete or not\n% accurate in any sense.\n%\n% By submitting a query you agree not to use the information made\n% available to:\n%\n% - allow, enable or otherwise support the transmission of unsolicited,\n% commercial advertising or other solicitations whether via email or\n% otherwise;\n% - target advertising in any possible way;\n%\n% - to cause nuisance in any possible way to the registrants by sending\n% (whether by automated, electronic processes capable of enabling\n% high volumes or other possible means) messages to them.\n%\n% Without prejudice to the above, it is explicitly forbidden to extract,\n% copy and/or use or re-utilise in any form and by any means\n% (electronically or not) the whole or a quantitatively or qualitatively\n% substantial part of the contents of the WHOIS database without prior\n% and explicit permission by EURid, nor in any attempt hereof, to apply\n% automated, electronic processes to EURid (or its systems).\n%\n% You agree that any reproduction and/or transmission of data for\n% commercial purposes will always be considered as the extraction of a\n% substantial part of the content of the WHOIS database.\n%\n% By submitting the query you agree to abide by this policy and accept\n% that EURid can take measures to limit the use of its WHOIS services\n% in order to protect the privacy of its registrants or the integrity\n% of the database.\n%\n% The EURid WHOIS service on port 43 (textual whois) never\n% discloses any information concerning the registrant.\n% Registrant and on-site contact information can be obtained through use of the\n% webbased WHOIS service available from the EURid website www.eurid.eu\\n%\\n% WHOIS l2.eu\nDomain: l2.eu\nScript: LATIN\n\nRegistrant:\n NOT DISCLOSED!\n Visit www.eurid.eu for webbased WHOIS.\n\nOn-site(s):\n NOT DISCLOSED!\n Visit www.eurid.eu for webbased WHOIS.\n\nRegistrar:\n Name: GoDaddy.com, LLC\n Website: http://www.godaddy.com\\n\\nName servers:\n ns2.inn.eu\n ns4.inn.ru\n ns5.inn.ru\n ns1.inn.eu\n\nPlease visit www.eurid.eu for more info.\n""

Doesn't show expire time for .com.au domain

There is issue with specific domain, it doesnt fetch any info.

10:24PM ERR failed to probe .com.au error="could not parse whois response: \"Domain Name: dd.COM.AU\\r\\nRegistry Domain ID: -AU\\r\\nRegistrar WHOIS Server: whois.auda.org.au\\r\\nRegistrar URL: https://www.crazydomains.com.au/contact/\\r\\nLast Modified: 2022-07-13T14:19:31Z\\r\\nRegistrar Name: Web Address Registration Pty Ltd\\r\\nRegistrar Abuse Contact Email: [email protected]\\r\\nRegistrar Abuse Contact Phone: +61.894220890\\r\\nReseller Name:\\r\\nStatus: serverRenewProhibited https://afilias.com.au/get-au/whois-status-codes#serverRenewProhibited\\r\\nStatus Reason: Not Currently Eligible For Renewal\\r\\nRegistrant Contact ID: R0-SN\\r\\nRegistrant Contact Name: \\r\\nTech Contact ID: Company\\r\\n\\r\\n>>> Last update of WHOIS database: 2022-09-04T22:24:37Z <<<\\r\\n\\r\\n\\r\\n\\r\\nAfilias Australia Pty Ltd (Afilias), for itself and on behalf of .au Domain Administration Limited (auDA), makes the WHOIS registration data directory service (WHOIS Service) available solely for the purposes of:\\n\\n(a) querying the availability of a domain name licence;\\n\\n(b) identifying the holder of a domain name licence; and/or\\n\\n(c) contacting the holder of a domain name licence in relation to that domain name and its use.\\n\\nThe WHOIS Service must not be used for any other purpose (even if that purpose is lawful), including:\\n\\n(a) aggregating, collecting or compiling information from the WHOIS database, whether for personal or commercial purposes;\\n\\n(b) enabling the sending of unsolicited electronic communications; and / or\\n\\n(c) enabling high volume, automated, electronic processes that send queries or data to the systems of Afilias, any registrar, any domain name licence holder, or auDA.\\n\\nThe WHOIS Service is provided for information purposes only. By using the WHOIS Service, you agree to be bound by these terms and conditions. The WHOIS Service is operated in accordance with the auDA WHOIS Policy (available at https://www.auda.org.au/policies/index-of-published-policies/2014/2014-07/ ).\\r\\n\""
image

[Docs] Update "--config" information

When using docker compose, the documentation didn't explicitly state information for docker & docker compose, as well as the note that when trying to use the "--config" parameter, an equal sign must be used to set the variable.

If the docs explained something like "when using docker / docker compose, you will use --config=/domains.yaml and you can add this parameter in your compose file by adding the "commands:" section.

Dependabot can't resolve your Go dependency files

Dependabot can't resolve your Go dependency files.

As a result, Dependabot couldn't update your dependencies.

The error Dependabot encountered was:

github.com/caarlos0/domain_exporter/internal/client: cannot find module providing package github.com/caarlos0/domain_exporter/internal/client
github.com/caarlos0/domain_exporter imports
	github.com/caarlos0/domain_exporter/internal/collector: cannot find module providing package github.com/caarlos0/domain_exporter/internal/collector
github.com/caarlos0/domain_exporter imports
	github.com/caarlos0/domain_exporter/internal/rdap: cannot find module providing package github.com/caarlos0/domain_exporter/internal/rdap
github.com/caarlos0/domain_exporter imports
	github.com/caarlos0/domain_exporter/internal/whois: cannot find module providing package github.com/caarlos0/domain_exporter/internal/whois
go: downloading github.com/alecthomas/kingpin v1.3.7
go: downloading github.com/patrickmn/go-cache v1.0.0

If you think the above is an error on Dependabot's side please don't hesitate to get in touch - we'll do whatever we can to fix it.

View the update logs.

Registry expiration date vs Registrar expiration date

Sometimes when the domain is already (auto)renewed, registrar expiration date is correct, but registry expiration date is still old (this can last up to 45 days or so)

Example:

Registry Expiry Date: 2021-07-28T14:07:04Z
Registrar Registration Expiration Date: 2022-07-28T07:00:00Z

This gives a false-positive alert.
Probably "Registrar Registration Expiration Date" must be added to regexp.

Could not parse date for .tv domain

Hi.

I am getting errors like this:


[90m1:57PM�[0m �[1m�[31mERR�[0m�[0m failed to probe nuorder.tv �[36merror=�[0m�[31m"could not parse date: \"displayed in this record is the date the\""�[0m

I tried to add --debug but it doesn't print anything interesting.
Exporter version - caarlos0/domain_exporter:v1.17.1

Could you please help?
Thanks.

.in and .co domains not working

Looks like whois requests are going to 103.132.246.21:43.... is this hardcoded anywhere?
Why is this not using linux command "whois" ?
Is it possible to specify a whois host for a specific record?

Logs: Apr 17 16:29:44 monitoring domain_exporter[643854]: 4:29PM ERR failed to probe {techpartner.in } error="failed to fetch whois request: read tcp 172.30.10.xxx:4:43874->103.132.246.21:43: read: connection reset by peer"
Apr 17 16:33:49 monitoring domain_exporter[643854]: net.Error timeout=false, temp=false: read tcp 172.30.10.xxx:48578->52.4.69.60:43: read: connection reset by peer

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.