You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-15 - 19:04

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #8

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Congatec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot8s.osadl.org (updated Sun Mar 15, 2026 12:43:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
15204519911650,1161cyclictest19629332sleep312:29:573
15204519911141,1109cyclictest17162902sleep309:40:023
1520451993310,328cyclictest1560102-21turbostat07:44:553
1520451993070,304cyclictest1774151-21turbostat10:24:553
72699240,8ntpd1534139-21ntpq07:15:190
72699240,6ntpd1767171-21apt-get10:15:120
72699240,12ntpd1682313-21grep09:15:162
72699230,9ntpd1795041-21ssh10:32:051
72699230,8ntpd1751668-21ssh10:03:162
72699230,6ntpd1653859-21apt-get08:55:122
72699230,6ntpd1584150-21ntpq07:55:220
72699230,6ntpd1540389-21ntpq07:20:191
72699230,11ntpd34-21ksoftirqd/108:40:121
72699220,7ntpd1815639-21head10:45:171
72699220,6ntpd1902958-21ntpq11:45:170
72699220,6ntpd1811980-21irqstats10:45:150
72699220,6ntpd1728770-21ntp_states09:45:210
72699220,6ntpd1652724-21ntp_states08:50:221
72699220,6ntpd1585312-21apt-get08:00:122
72699220,6ntpd1584099-21ntpq07:55:211
72699220,5ntpd1968406-21ntpq12:30:220
72699220,5ntpd1905132-21apt-get11:50:112
72699220,5ntpd1671424-21ntpq09:05:192
72699220,5ntpd1665260-21ntp_states09:00:211
72699220,5ntpd1554067-21apt-get07:35:110
72699220,4ntpd1738047-21ssh09:55:131
72699220,2ntpd0-21swapper/012:15:220
72699220,10ntpd1887581-21tr11:35:170
72699210,8ntpd1565551-21/usr/sbin/munin07:40:220
72699210,7ntpd1672369-21diskmemload11:09:050
72699210,5ntpd1956280-21hddtemp_smartct12:25:150
72699210,5ntpd1925405-21ssh12:00:550
72699210,5ntpd1815797-21ntpq10:45:202
72699210,5ntpd1774468-21apt-get10:20:121
72699210,5ntpd1743147-21ntpq09:55:220
72699210,5ntpd1709119-21apt-get09:35:091
72699210,5ntpd1672688-21apt-get09:10:100
72699210,5ntpd1627698-21ntpq08:30:182
72699210,5ntpd1616474-21apt-get08:25:111
72699210,5ntpd1560381-21apt-get07:40:111
72699210,5ntpd1552828-21ntpq07:30:190
72699210,5ntpd1519820-21users07:05:250
72699210,5ntpd1519249-21ntpq07:05:202
72699210,4ntpd1728663-21ssh09:45:191
72699210,4ntpd1541640-21apt-get07:25:111
72699210,3ntpd1694639-21ssh09:25:111
72699210,3ntpd1687435-21ssh09:20:102
72699200,8ntpd1910896-21ssh11:50:430
72699200,7ntpd1922939-21kthreadcore12:00:162
72699200,7ntpd1759231-21ssh10:09:321
72699200,7ntpd1672369-21diskmemload09:50:591
72699200,7ntpd1644234-21cut08:45:151
72699200,6ntpd1810177-21ssh10:44:341
72699200,6ntpd1744432-21ssh09:58:152
72699200,6ntpd1672369-21diskmemload11:28:340
72699200,6ntpd1520700-21cat07:10:010
72699200,5ntpd1931900-21ntpq12:05:191
72699200,5ntpd1903012-21ntpq11:45:181
72699200,5ntpd1881075-21ntp_states11:30:210
72699200,5ntpd1866513-21ntpq11:20:170
72699200,5ntpd1861182-21munin-run11:19:590
72699200,5ntpd1837466-21ntpq11:00:202
72699200,5ntpd1808511-21ntpq10:40:210
72699200,5ntpd1786870-21ntpq10:25:230
72699200,5ntpd1721687-21python309:40:230
72699200,5ntpd1721508-21ntpq09:40:212
72699200,5ntpd1721452-21ntpq09:40:201
72699200,5ntpd1694788-21df09:25:120
72699200,5ntpd1672079-21updatedb.plocat09:06:320
72699200,5ntpd1535564-21diskstats07:20:120
72699200,4ntpd1817845-21apt-get10:50:122
72699200,4ntpd1679588-21apt-get09:15:011
72699200,4ntpd1597748-21apt-get08:10:120
72699200,2ntpd0-21swapper/009:35:190
72699200,1ntpd0-21swapper/210:20:212
72699200,10ntpd420-21hwrng09:33:401
72699190,6ntpd1918842-21sh11:58:332
72699190,6ntpd1897564-21ssh11:44:592
72699190,6ntpd1772270-21ntpq10:15:201
72699190,6ntpd1747095-21grep10:00:160
72699190,6ntpd1672369-21diskmemload12:20:352
72699190,6ntpd1574142-21irqstats07:50:151
72699190,6ntpd1550910-21kthreadcore07:30:162
72699190,5ntpd1910281-21ntpq11:50:201
72699190,5ntpd1890987-21/usr/sbin/munin11:40:150
72699190,5ntpd1882436-21ssh11:33:351
72699190,5ntpd1837505-21ntpq11:00:201
72699190,5ntpd1810149-21ssh10:44:282
72699190,5ntpd1794483-21/usr/sbin/munin10:30:232
72699190,5ntpd1759842-21diskstats10:10:120
72699190,5ntpd1693100-21users09:20:240
72699190,5ntpd1685331-21ntp_states09:15:220
72699190,5ntpd1672369-21diskmemload09:34:182
72699190,5ntpd1658981-21ntp_states08:55:210
72699190,5ntpd1602853-21ntp_states08:10:212
72699190,5ntpd1586654-21irqstats08:00:150
72699190,5ntpd1585104-21sed08:00:002
72699190,4ntpd1934019-21apt-get12:10:101
72699190,4ntpd1874783-21ssh11:27:001
72699190,4ntpd1860664-21ssh11:18:072
72699190,4ntpd1846780-21apt-get11:10:120
72699190,4ntpd1825043-21apt-get10:55:132
72699190,4ntpd1755459-21sed10:05:150
72699190,4ntpd1660314-21uniq09:00:130
72699190,4ntpd1641168-21munin-run08:44:590
72699190,3ntpd1888306-21ssh11:35:211
72699190,2ntpd1912357-21ssh11:55:121
72699190,2ntpd0-21swapper/210:35:222
72699190,2ntpd0-21swapper/107:15:201
72699180,6ntpd1767478-21basename10:15:152
72699180,5ntpd1824653-21seq10:54:481
72699180,5ntpd1788988-21/usr/sbin/munin10:30:120
72699180,5ntpd1765483-21sh10:10:501
72699180,5ntpd1665427-21switchtime09:00:232
72699180,5ntpd1653120-21unixbench_multi08:50:252
72699180,5ntpd1590299-21ntpq08:00:201
72699180,4ntpd1961151-21ssh12:25:242
72699180,4ntpd1952154-21cut12:20:170
72699180,4ntpd1941268-21apt-get12:15:111
72699180,4ntpd1904567-21ssh11:49:082
72699180,4ntpd1889728-21ssh11:38:532
72699180,4ntpd1875257-21ssh11:28:492
72699180,4ntpd1837617-21mailstats11:00:210
72699180,4ntpd1735732-21memory09:50:160
72699180,4ntpd1677858-21ntpq09:10:212
72699180,4ntpd1672369-21diskmemload11:59:320
72699180,4ntpd1670659-21cut09:05:171
72699180,4ntpd1634120-21processes08:35:220
72699180,4ntpd1622880-21fschecks_count08:30:121
72699180,4ntpd1615341-21ntpq08:20:211
72699180,4ntpd1609108-21ntpq08:15:230
72699180,4ntpd1592369-21sed08:05:151
72699180,4ntpd1577857-21ntpq07:50:202
72699180,3ntpd1970461-21apt-get12:35:102
72699180,3ntpd1955987-21apt-get12:25:131
72699180,2ntpd1924763-21ssh12:00:211
72699180,2ntpd0-21swapper/110:25:231
72699180,2ntpd0-21swapper/010:50:210
72699170,5ntpd1867558-21runrttasks11:22:012
72699170,4ntpd1976156-21users12:35:250
72699170,4ntpd1969115-21ssh12:31:121
72699170,4ntpd1932611-21sshd12:05:532
72699170,4ntpd1895916-21ssh11:40:241
72699170,4ntpd1646342-21cut08:45:172
72699170,4ntpd1625136-21tr08:30:150
72699170,4ntpd1615157-21grep08:20:182
72699170,4ntpd1595444-21kthreadcore08:05:170
72699170,3ntpd1969048-21ssh12:30:512
72699170,3ntpd1846784-21ssh11:10:132
72699170,3ntpd1842523-21kthreadcore11:05:151
72699170,3ntpd1799687-21cut10:35:171
72699170,3ntpd1787557-21ssh10:26:062
72699170,3ntpd1722365-21kworker/u16:4-nfsiod09:49:322
72699170,3ntpd1693332-21ssh09:21:191
72699170,3ntpd1602102-21kthreadcore08:10:181
72699170,3ntpd1572678-21latency_hist07:49:591
72699170,3ntpd1521861-21irqrtprio07:10:191
72699170,3ntpd1520205-21apt-get07:10:022
72699170,2ntpd1861775-21ssh11:20:121
72699170,2ntpd1750326-21ssh10:00:201
72699170,2ntpd0-21swapper/212:10:202
72699170,2ntpd0-21swapper/211:05:102
16954072170,1sleep30-21swapper/309:25:153
161998170,2rtkit-daemon0-21swapper/108:16:361
152045199175,8cyclictest1653581-21turbostat08:54:593
152045199171,12cyclictest1766678-21taskset10:15:003
72699160,9ntpd1507906-21kworker/0:0+kacpid07:29:420
72699160,4ntpd1947261-21ssh12:16:422
72699160,4ntpd1853554-21ssh11:14:351
72699160,4ntpd1766142-21ssh10:13:182
72699160,4ntpd1737583-21ssh09:54:332
72699160,4ntpd1715096-21ssh09:36:312
72699160,4ntpd1567591-21sed07:45:152
72699160,3ntpd1881887-21ssh11:31:362
72699160,3ntpd1857650-21grep11:15:161
72699160,3ntpd1825637-21sed10:55:161
72699160,3ntpd1774937-21irqcore10:20:140
72699160,3ntpd1702137-21fschecks_time09:30:130
72699160,3ntpd1678680-21ssh09:11:471
72699160,3ntpd1652338-21kthreadcore08:50:180
72699160,3ntpd1560300-21latency_hist07:40:002
72699160,3ntpd1546690-21ntpq07:25:202
72699160,3ntpd1539202-21cut07:20:162
72699160,2ntpd0-21swapper/208:15:192
72699160,2ntpd0-21swapper/008:25:210
72699160,2ntpd0-21swapper/007:45:200
1520451991613,1cyclictest0-21swapper/309:20:063
152045199161,11cyclictest1852657-21taskset11:11:133
152045199161,11cyclictest1601604-21taskset08:10:173
152045199161,11cyclictest1526821-21taskset07:15:013
152045199161,10cyclictest18830952sleep311:35:123
152045199161,10cyclictest1560096-21turbostat07:40:003
72699150,6ntpd420-21hwrng07:51:160
72699150,3ntpd1949886-21ssh12:20:161
72699150,3ntpd1826586-21kthreadcore10:55:170
72699150,3ntpd1796787-21irqcore10:35:150
72699150,3ntpd1700842-21ssh09:27:192
72699150,3ntpd1616229-21unin-run08:25:000
72699150,2ntpd0-21swapper/210:05:212
72699150,2ntpd0-21swapper/107:30:191
72699150,2ntpd0-21swapper/012:05:210
72699150,2ntpd0-21swapper/008:45:200
72699150,1ntpd0-21swapper/208:35:112
72699150,1ntpd0-21swapper/112:35:321
72699150,1ntpd0-21swapper/012:10:120
152045199154,8cyclictest1745156-21taskset10:00:003
152045199154,7cyclictest17874072sleep310:25:353
1520451991513,1cyclictest0-21swapper/311:40:003
1520451991513,0cyclictest0-21swapper/310:40:243
1520451991513,0cyclictest0-21swapper/307:56:373
1520451991512,1cyclictest0-21swapper/312:19:253
1520451991512,1cyclictest0-21swapper/311:47:073
1520451991512,1cyclictest0-21swapper/311:04:463
1520451991512,1cyclictest0-21swapper/310:31:373
1520451991512,1cyclictest0-21swapper/310:18:353
1520451991512,1cyclictest0-21swapper/307:51:213
1520451991512,1cyclictest0-21swapper/307:15:183
152045199151,11cyclictest1868390-21sleep11:25:003
152045199151,11cyclictest1860839-21taskset11:18:483
152045199151,10cyclictest1845275-21taskset11:05:333
72699140,2ntpd0-21swapper/108:55:181
72699140,2ntpd0-21swapper/107:35:221
72699140,1ntpd0-21swapper/208:40:192
152045199145,6cyclictest1802623-21taskset10:38:243
152045199145,6cyclictest1647009-21taskset08:45:323
152045199144,7cyclictest19490982sleep312:20:153
152045199141,9cyclictest17380082sleep309:55:133
152045199141,9cyclictest1680010-21chrt09:15:013
1520451991413,0cyclictest0-21swapper/312:37:193
1520451991412,1cyclictest0-21swapper/312:33:353
1520451991412,1cyclictest0-21swapper/308:08:133
1520451991412,1cyclictest0-21swapper/307:22:323
1520451991411,1cyclictest0-21swapper/311:30:133
1520451991411,1cyclictest0-21swapper/309:38:363
1520451991411,1cyclictest0-21swapper/309:13:103
152045199141,10cyclictest1937714-21taskset12:10:173
152045199141,10cyclictest1824172-21chrt10:52:593
152045199141,10cyclictest1667359-21taskset09:05:143
152045199141,10cyclictest1666123-21turbostat09:05:003
152045199141,10cyclictest1659650-21taskset08:57:463
152045199141,10cyclictest1636300-21taskset08:40:153
152045199141,10cyclictest1616067-21taskset08:23:323
152045199141,10cyclictest1553734-21chrt07:34:283
152045199141,10cyclictest1547548-21chrt07:29:313
72699130,2ntpd0-21swapper/208:25:162
72699130,2ntpd0-21swapper/208:05:162
72699130,2ntpd0-21swapper/207:15:212
72699130,2ntpd0-21swapper/107:05:181
72699130,1ntpd0-21swapper/108:35:041
152045199131,9cyclictest1868698-21taskset11:25:123
152045199131,9cyclictest1706984-21taskset09:30:203
152045199131,9cyclictest1634536-21taskset08:35:263
152045199131,9cyclictest1616477-21taskset08:25:133
152045199131,9cyclictest1585315-21taskset08:00:133
1520451991311,1cyclictest0-21swapper/308:30:053
152045199131,10cyclictest1912283-21taskset11:55:023
1520451991311,0cyclictest0-21swapper/310:05:193
1520451991310,1cyclictest0-21swapper/310:56:323
1520451991310,1cyclictest0-21swapper/310:45:533
1520451991310,1cyclictest0-21swapper/309:45:153
152045199130,9cyclictest19054282sleep311:50:143
152045199130,10cyclictest1933604-21taskset12:09:373
152045199130,10cyclictest1736389-21chrt09:50:243
152045199130,10cyclictest1604166-21chrt08:15:153
152045199130,10cyclictest1572180-21taskset07:45:463
72699120,1ntpd0-21swapper/207:40:152
152045199120,9cyclictest1919535-21taskset12:00:073
15200742120,3sleep30-21swapper/307:08:373
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional