Designing Great Products: The Power of Design and Leadership by Chief Designe...
RIPE Database Update
1. RIPE Network Coordination Centre
RIPE 60 Database Update
Paul Palse
Database Manager, RIPE NCC
Paul Palse RIPE 60 http://www.ripe.net 1
2. RIPE Network Coordination Centre
Outline
• Introduction of the DB Group
• Projects and external commitments
• Operational update and RIPE-DBM
• RIPE Labs prototypes
• Questions
Paul Palse RIPE 60 http://www.ripe.net 2
7. RIPE Network Coordination Centre
AP54.3: MNT-BY on Person/Role
• Documentation is ready
• Test environment deployed right after RIPE 59
• No issues were reported
• Deploy to production next month…
Paul Palse RIPE 60 http://www.ripe.net 7
8. RIPE Network Coordination Centre
AP54.6: Clean-Up Unreferenced Persons
• Restarted at end of February
• Cleanup is complete
• Deletion is set to 90 days after first becoming
unreferenced
Paul Palse RIPE 60 http://www.ripe.net 8
9. RIPE Network Coordination Centre
AP58.1: ASUSED support for IPv6
• Currently only available via web interface
• Will be integrated in the new portal software with
full IPv6 support.
Paul Palse RIPE 60 http://www.ripe.net 9
10. RIPE Network Coordination Centre
AP59.1: Reverse Delegation Safeguards
• The DNS group is upgrading their provisioning
software
• Database Group will implement the additional
rules as part of that development
Paul Palse RIPE 60 http://www.ripe.net 10
11. RIPE Network Coordination Centre
AP59.2: Clean-Up Unreferenced Persons
• Sent detailed explanation mid February (AP59.2)
• Now an ongoing process…
Paul Palse RIPE 60 http://www.ripe.net 11
12. RIPE Network Coordination Centre
AP59.3: Documentation in HTML
• Update reference manual done
• Query reference manual to follow shortly…
Paul Palse RIPE 60 http://www.ripe.net 12
13. RIPE Network Coordination Centre
AP59.4, AP59.5 and AP59.6
• Advanced search on KEY-CERT objects
• We didn’t see a proposal on the DB WG mailing
list
• This could be a candidate for a “Use Case”
search tool
• “Use Case” search tool ?
• Yes, “Use Case” search tool…
Paul Palse RIPE 60 http://www.ripe.net 13
15. RIPE Network Coordination Centre
NRTM/Split files without personal data
• NRTM and split files without NIC-HDLs
• Software is ready
• Documentation is almost ready
• Test environment was deployed right after RIPE
59
• We’ll put it in production when the
documentation is ready…
Paul Palse RIPE 60 http://www.ripe.net 15
16. RIPE Network Coordination Centre
RIPE NCC’s Other Database Mirrors
• We re-loaded them shortly after RIPE 59
• We are out of sync again
• We will investigate a more reliable process…
Paul Palse RIPE 60 http://www.ripe.net 16
17. RIPE Network Coordination Centre
Operational Update
RIPE-DBM
Paul Palse RIPE 60 http://www.ripe.net 17
18. RIPE Network Coordination Centre
RIPE-DBM
• First line:
Customer Service
• Second line:
Database group
Laura (manager) Henriette Ronen
Milena Marisol
Paul Palse RIPE 60 http://www.ripe.net 18
21. RIPE Network Coordination Centre
Stats: Whois Queries per minute
2009 2010
• Average queries p/m over a year: 8,617
• IPv6 > 1.5%
http://www.ripe.net/info/stats/db/
Paul Palse RIPE 60 http://www.ripe.net 21
22. RIPE Network Coordination Centre
Whois Queries – Usage by Country
Between RIPE 59 and 60 Between RIPE 58 and 59
.de .de
19% Other 20%
Other
.pl
.pt
.it
.uy .cz
.se
.ch
.pl
.se
.es .us
16% .hu
.ch .ua .us
.it .ua .nl .fr 17%
.gb .gb
5% .ru 9% .ru
7% .nl
.fr 7% 11%
8%
5%
Paul Palse RIPE 60 http://www.ripe.net 22
23. RIPE Network Coordination Centre
Query Distribution per Month
Queries per unique IP
2%
16%
1 to 10
11 to 100
101 to 1,000
1,001 to 10,000
10,001 to 100,000
79%
100,000 to 1.000,000
1,000,000+
Paul Palse RIPE 60 http://www.ripe.net 23
24. RIPE Network Coordination Centre
Stats: Successful Whois Updates
• Average updates over a year: 36 per minute
http://www.ripe.net/info/stats/db/
Paul Palse RIPE 60 http://www.ripe.net 24
25. RIPE Network Coordination Centre
Whois Updates - Distribution
Update Method Update Types
1% 7%
4%
30%
41%
51%
66%
Successful
Failed
Help
Spam
sync mail Web
Paul Palse RIPE 60 http://www.ripe.net 25
26. RIPE Network Coordination Centre
EgoQuery TM
Hosts that queried for their own IP
Facts (time between RIPE 59-60): Queries
• No flags used
9%
• Total > 240,000,000 Queries
• NL: 16%
• GB: 12%
91%
• BE, PL, DE, ES: 6%
• 80% 1-10 queries
• 2% 11-100 queries
• Again, what is this… Regular EgoQuery
Paul Palse RIPE 60 http://www.ripe.net 26
27. RIPE Network Coordination Centre
RIPE DB: Query and Update Uptime
100.000%
99.995%
99.990%
99.985%
99.980%
99.975%
RIPE 60 RIPE 59
Queries Mail Updates Sync Updates
Paul Palse RIPE 60 http://www.ripe.net 27
28. RIPE Network Coordination Centre
RIPE Database
Publications on RIPE Labs
Paul Palse RIPE 60 http://www.ripe.net 28
29. RIPE Network Coordination Centre
Publications on RIPE Labs
• RIPE Database Query API in the form of
RESTful Web Services:
- REST allows for “create, read, update, and delete”
transactions over HTTP
- Resources have a unique portable address in the form
of an URL
- Web Service responds in XML and JSON
- Response is easy to parse by script
- XML can be easily transformed (to RPSL for example)
using style sheets
- Protocol has big industry support. Google, Amazon…
Paul Palse RIPE 60 http://www.ripe.net 29
30. RIPE Network Coordination Centre
RIPE Database RESTful Query WS
Paul Palse RIPE 60 http://www.ripe.net 30
31. RIPE Network Coordination Centre
“Use Case” search
• Precise answer to a specific question
• Give me the Abuse Handler details for this network
resource? (Demo in Anti Abuse WG Session…)
• Other “Use Case” searches please…
Paul Palse RIPE 60 http://www.ripe.net 31
32. RIPE Network Coordination Centre
Registry Data in the RIPE Database
Presenting registry data in the RIPE
Database
Paul Palse RIPE 60 http://www.ripe.net 32
33. RIPE Network Coordination Centre
Problem Statement
• As an RIR it is important that we hold accurate
registry data.
• Consumers of this data need to have trust in its
accuracy.
• RIPE NCC has no direct control over the user
data entered into the RIPE Database.
• Therefore any inaccuracies found in the user
data, or conflicts between different sources of
data, reflect on the whole data set.
Pual Palse RIPE 60 http://www.ripe.net 33
34. RIPE Network Coordination Centre
Principles
• Present a clear distinction between the registry
and user data
• Minimise inconsistencies, while facilitating the
ability of the users to keep their data current
• Minimise the impact of any change on the
maintainers of user data
• Minimise the changes needed to RIPE DB
software.
Pual Palse RIPE 60 http://www.ripe.net 34