You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-28 - 11:00

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #8, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack8slot6s.osadl.org (updated Tue Jul 28, 2026 00:43:43)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
27785991818,0cyclictest65850irq/126-lan22:25:220
27785991818,0cyclictest65850irq/126-lan21:55:210
27785991818,0cyclictest65850irq/126-lan20:10:220
27785991817,1cyclictest65850irq/126-lan23:30:160
27785991817,1cyclictest65850irq/126-lan23:10:190
27785991817,1cyclictest65850irq/126-lan21:25:230
27785991817,1cyclictest65850irq/126-lan20:40:170
27785991817,1cyclictest65850irq/126-lan19:25:130
27785991817,1cyclictest65850irq/126-lan00:25:130
27785991717,0cyclictest65850irq/126-lan22:30:190
27785991717,0cyclictest65850irq/126-lan20:15:170
27785991717,0cyclictest65850irq/126-lan00:35:000
27785991716,1cyclictest65850irq/126-lan23:25:260
27785991716,1cyclictest65850irq/126-lan22:54:550
27785991716,1cyclictest65850irq/126-lan22:10:150
27785991716,1cyclictest65850irq/126-lan21:50:120
27785991716,1cyclictest65850irq/126-lan21:30:180
27785991716,1cyclictest65850irq/126-lan19:15:470
27785991716,1cyclictest65850irq/126-lan19:10:140
27785991716,1cyclictest65850irq/126-lan00:10:140
27785991616,0cyclictest65850irq/126-lan23:15:210
27785991616,0cyclictest65850irq/126-lan22:35:210
27785991616,0cyclictest65850irq/126-lan21:16:450
27785991616,0cyclictest65850irq/126-lan19:54:440
27785991616,0cyclictest65850irq/126-lan19:30:170
27785991615,1cyclictest65850irq/126-lan22:15:190
27785991615,1cyclictest65850irq/126-lan21:00:010
27785991615,1cyclictest65850irq/126-lan20:50:220
27785991615,1cyclictest65850irq/126-lan20:50:210
27785991615,1cyclictest65850irq/126-lan20:45:230
27785991615,1cyclictest65850irq/126-lan19:20:110
27785991615,1cyclictest65850irq/126-lan00:00:010
27785991515,0cyclictest65850irq/126-lan22:40:160
27785991515,0cyclictest65850irq/126-lan20:38:440
27785991515,0cyclictest65850irq/126-lan20:05:140
27785991515,0cyclictest65850irq/126-lan19:59:450
27785991515,0cyclictest65850irq/126-lan19:46:450
27785991515,0cyclictest65850irq/126-lan00:05:140
27785991514,1cyclictest65850irq/126-lan23:55:140
27785991514,1cyclictest65850irq/126-lan22:05:140
27785991514,1cyclictest65850irq/126-lan21:40:120
27785991514,1cyclictest65850irq/126-lan20:30:010
27785991514,1cyclictest65850irq/126-lan00:30:210
27785991414,0cyclictest65850irq/126-lan23:47:130
27785991414,0cyclictest65850irq/126-lan23:20:170
27785991414,0cyclictest65850irq/126-lan23:05:180
27785991414,0cyclictest65850irq/126-lan23:02:180
27785991413,1cyclictest65850irq/126-lan23:50:160
27785991413,1cyclictest65850irq/126-lan23:35:140
27785991413,1cyclictest65850irq/126-lan21:05:210
27785991413,1cyclictest65850irq/126-lan21:00:470
27785991413,1cyclictest65850irq/126-lan20:00:230
27785991413,1cyclictest65850irq/126-lan19:35:130
27785991313,0cyclictest65850irq/126-lan22:02:140
27785991313,0cyclictest65850irq/126-lan19:43:560
27785991313,0cyclictest65850irq/126-lan00:15:180
27785991312,1cyclictest65850irq/126-lan22:55:170
27785991312,1cyclictest65850irq/126-lan21:20:140
27785991312,1cyclictest65850irq/126-lan21:10:010
27785991312,1cyclictest65850irq/126-lan20:33:100
27785991312,1cyclictest65850irq/126-lan00:20:140
27785991212,0cyclictest65850irq/126-lan22:46:460
27785991212,0cyclictest65850irq/126-lan21:45:100
27785991211,1cyclictest65850irq/126-lan23:40:160
27785991211,1cyclictest65850irq/126-lan22:20:170
27785991111,0cyclictest65850irq/126-lan21:35:200
27785991111,0cyclictest65850irq/126-lan20:20:120
278019998,1cyclictest743-21snmpd21:57:473
278019998,1cyclictest741-21lldpd23:42:573
278019998,1cyclictest741-21lldpd22:42:033
278019998,1cyclictest741-21lldpd22:29:133
278019998,1cyclictest1462-21needreboot20:40:153
277959998,1cyclictest743-21snmpd20:25:412
277959998,1cyclictest743-21snmpd00:35:142
277959998,1cyclictest506-21systemd-resolve21:13:072
277959996,3cyclictest743-21snmpd23:03:442
277909998,1cyclictest743-21snmpd21:15:571
278019988,0cyclictest743-21snmpd23:27:563
278019988,0cyclictest743-21snmpd23:20:173
278019988,0cyclictest741-21lldpd20:31:163
278019988,0cyclictest741-21lldpd20:10:213
278019988,0cyclictest741-21lldpd19:16:223
278019987,1cyclictest7589-21ntp_offset22:15:183
278019987,1cyclictest743-21snmpd23:36:573
278019987,1cyclictest743-21snmpd19:57:433
278019987,1cyclictest743-21snmpd19:48:063
278019987,1cyclictest743-21snmpd19:34:593
278019987,1cyclictest741-21lldpd21:47:073
278019986,2cyclictest743-21snmpd23:33:243
278019986,2cyclictest743-21snmpd20:05:043
278019986,2cyclictest743-21snmpd00:08:433
277959988,0cyclictest743-21snmpd22:50:012
277959988,0cyclictest743-21snmpd22:03:482
277959988,0cyclictest743-21snmpd21:03:272
277959988,0cyclictest743-21snmpd19:51:272
277959988,0cyclictest743-21snmpd19:46:422
277959988,0cyclictest741-21lldpd23:23:322
277959987,1cyclictest743-21snmpd19:16:532
277959987,1cyclictest741-21lldpd23:41:372
277959987,1cyclictest573-21in:imuxsock21:32:332
277959986,2cyclictest743-21snmpd19:40:282
277909988,0cyclictest743-21snmpd23:40:181
277909988,0cyclictest743-21snmpd22:55:301
277909988,0cyclictest743-21snmpd22:53:581
277909988,0cyclictest741-21lldpd23:51:461
277909988,0cyclictest741-21lldpd22:48:261
277909988,0cyclictest741-21lldpd21:31:501
277909988,0cyclictest741-21lldpd20:42:141
277909988,0cyclictest741-21lldpd19:46:531
277909987,1cyclictest743-21snmpd23:28:551
277909987,1cyclictest743-21snmpd22:25:061
277909987,1cyclictest743-21snmpd21:14:071
277909987,1cyclictest743-21snmpd00:23:221
277909986,2cyclictest743-21snmpd23:34:241
277909986,2cyclictest743-21snmpd19:22:411
277909986,2cyclictest743-21snmpd00:06:071
277909986,2cyclictest16642-21cat20:00:161
278019977,0cyclictest743-21snmpd22:48:523
278019977,0cyclictest743-21snmpd20:00:363
278019977,0cyclictest743-21snmpd00:26:553
278019977,0cyclictest743-21snmpd00:20:073
278019977,0cyclictest741-21lldpd22:54:573
278019977,0cyclictest741-21lldpd00:35:253
278019976,1cyclictest743-21snmpd23:55:533
278019976,1cyclictest743-21snmpd23:51:303
278019976,1cyclictest743-21snmpd22:21:473
278019976,1cyclictest743-21snmpd22:06:413
278019976,1cyclictest743-21snmpd21:33:223
278019975,2cyclictest743-21snmpd23:09:143
278019975,2cyclictest743-21snmpd22:12:393
277959977,0cyclictest743-21snmpd20:41:062
277959976,1cyclictest743-21snmpd22:41:042
277959976,1cyclictest25318-21gltestperf21:40:132
277959975,2cyclictest743-21snmpd23:34:542
277959975,2cyclictest743-21snmpd22:37:002
277959975,2cyclictest743-21snmpd21:18:482
277959975,2cyclictest743-21snmpd20:08:222
277959975,2cyclictest743-21snmpd19:12:512
277959975,2cyclictest32271-21cat23:15:152
277959972,5cyclictest557-21NetworkManager22:23:032
277909977,0cyclictest743-21snmpd21:59:261
277909977,0cyclictest743-21snmpd21:29:101
277909977,0cyclictest743-21snmpd21:20:131
277909977,0cyclictest743-21snmpd20:56:451
277909977,0cyclictest741-21lldpd22:21:371
277909977,0cyclictest741-21lldpd22:06:301
277909977,0cyclictest741-21lldpd22:01:271
277909977,0cyclictest741-21lldpd19:50:301
277909976,1cyclictest743-21snmpd23:10:101
277909976,1cyclictest522-21avahi-daemon22:30:021
277909975,2cyclictest743-21snmpd20:55:001
277909975,2cyclictest743-21snmpd20:54:591
277909974,2cyclictest244-20systemd-journal20:45:151
278019966,0cyclictest743-21snmpd23:11:053
278019966,0cyclictest743-21snmpd21:03:113
278019966,0cyclictest741-21lldpd20:21:203
278019966,0cyclictest522-21avahi-daemon22:38:253
278019966,0cyclictest522-21avahi-daemon21:43:003
278019966,0cyclictest522-21avahi-daemon00:10:083
278019966,0cyclictest27068-21gltestperf20:25:153
278019965,1cyclictest743-21snmpd19:38:523
278019965,1cyclictest5257-21cat20:50:143
278019965,1cyclictest5257-21cat20:50:133
278019965,1cyclictest522-21avahi-daemon23:47:233
278019965,1cyclictest0-21swapper/321:20:003
278019964,2cyclictest743-21snmpd19:43:043
278019963,2cyclictest244-20systemd-journal19:50:023
278019962,3cyclictest2980-21diskstats20:45:143
278019961,4cyclictest557-21NetworkManager19:25:103
277959966,0cyclictest743-21snmpd22:32:372
277959966,0cyclictest741-21lldpd20:32:242
277959966,0cyclictest741-21lldpd00:31:292
277959966,0cyclictest522-21avahi-daemon20:53:292
277959966,0cyclictest522-21avahi-daemon20:53:282
277959966,0cyclictest522-21avahi-daemon20:47:372
277959965,1cyclictest7461-21needreboot20:55:172
277959965,1cyclictest743-21snmpd23:07:232
277959965,1cyclictest743-21snmpd21:55:172
277959965,1cyclictest743-21snmpd21:21:162
277959965,1cyclictest24766-21cpuspeed_turbos20:20:122
277959964,2cyclictest743-21snmpd23:13:342
277959963,3cyclictest2197-21memory19:25:152
277959963,3cyclictest20731-21awk21:30:012
277959963,3cyclictest20645-21apt-get20:10:142
277959963,2cyclictest32012-21ntp_states20:35:172
277959962,4cyclictest557-21NetworkManager22:49:572
277959962,3cyclictest23644-21fw_forwarded_lo22:55:152
277909966,0cyclictest743-21snmpd19:30:271
277909966,0cyclictest741-21lldpd23:00:521
277909966,0cyclictest741-21lldpd21:49:451
277909966,0cyclictest741-21lldpd20:18:031
277909966,0cyclictest741-21lldpd00:30:221
277909966,0cyclictest5995-21head19:35:131
277909966,0cyclictest2307-21needreboot19:25:151
277909965,1cyclictest573-21in:imuxsock19:11:001
277909965,1cyclictest522-21avahi-daemon23:35:211
277909965,1cyclictest506-21systemd-resolve22:18:021
277909965,1cyclictest29576-21dump-pmu-power23:10:001
277909965,1cyclictest24873-21fschecks_count20:20:131
277909965,1cyclictest244-20systemd-journal21:40:521
277909965,1cyclictest0-21swapper/100:00:121
277909964,2cyclictest743-21snmpd22:37:461
277909962,4cyclictest557-21NetworkManager20:05:111
277909961,5cyclictest557-21NetworkManager21:09:271
278019955,0cyclictest741-21lldpd21:52:133
278019955,0cyclictest741-21lldpd00:17:553
278019955,0cyclictest31536-21gltestperf20:35:143
278019954,1cyclictest743-21snmpd20:55:333
278019953,2cyclictest743-21snmpd22:01:113
278019953,2cyclictest743-21snmpd21:38:383
278019953,2cyclictest743-21snmpd21:25:133
278019953,2cyclictest743-21snmpd00:01:073
278019951,4cyclictest557-21NetworkManager22:33:143
278019951,3cyclictest23518-21diskstats22:55:143
278019951,2cyclictest32326-21head19:20:133
278019950,4cyclictest32707-21ntpq23:15:183
278019950,4cyclictest31203-21diskstats00:30:133
278019950,4cyclictest17789-21ntpq21:20:173
277959955,0cyclictest743-21snmpd23:38:122
277959955,0cyclictest743-21snmpd21:38:262
277959955,0cyclictest743-21snmpd00:01:432
277959954,1cyclictest522-21avahi-daemon19:30:012
277959954,1cyclictest14888-21ntp_kernel_err19:55:192
277959953,2cyclictest743-21snmpd00:18:012
277959953,2cyclictest11263-21cat22:25:152
277959952,3cyclictest5672-21apt-get19:35:122
277959952,3cyclictest557-21NetworkManager21:49:402
277959952,2cyclictest7786-21find22:15:202
277959952,2cyclictest244-20systemd-journal23:47:272
277959952,2cyclictest244-20systemd-journal21:50:412
277959952,2cyclictest22184-21sed00:05:222
277959951,3cyclictest5324-21memory22:10:142
277909955,0cyclictest743-21snmpd00:29:581
277909955,0cyclictest741-21lldpd19:41:051
277909954,1cyclictest522-21avahi-daemon23:45:071
277909954,1cyclictest14240-21cpuspeed_turbos19:55:141
277909954,1cyclictest0-21swapper/119:15:431
277909953,2cyclictest743-21snmpd00:11:371
277909953,2cyclictest23420-21cat21:35:131
277909953,2cyclictest18447-21cat00:00:001
277909952,3cyclictest557-21NetworkManager00:39:501
277909952,2cyclictest29896-21ntp_kernel_pll_20:30:171
277909952,2cyclictest29250-21sh21:50:121
277909952,2cyclictest27429-21sed20:25:181
277909952,2cyclictest25717-21ntp_kernel_pll_00:15:151
277909952,2cyclictest244-20systemd-journal23:20:111
277909952,2cyclictest21681-21mailstats20:10:221
277909950,5cyclictest18252-21grep22:40:301
278019942,2cyclictest557-21NetworkManager23:00:073
278019941,3cyclictest28405-21cat19:10:173
278019941,2cyclictest12914-21wc21:10:133
278019940,3cyclictest23422-21ntpq20:15:163
278019940,2cyclictest12653-21awk21:10:013
277959943,1cyclictest0-21swapper/221:05:162
277959942,2cyclictest643-21mailstats19:20:202
277959942,2cyclictest4199-21awk23:24:592
277959941,2cyclictest3475-21ntp_kernel_err22:05:162
277959941,2cyclictest27475-21cut00:20:152
277959941,2cyclictest22741-21expr20:15:122
277959941,2cyclictest16915-21ld20:00:182
277959941,2cyclictest14404-21seq23:50:042
277959940,4cyclictest17232-21ntpq23:55:192
277959940,3cyclictest29314-21perl00:25:132
277959940,3cyclictest22683-21cron00:10:002
277909941,2cyclictest9053-21awk21:00:131
277909941,2cyclictest5379-21cat22:10:151
277909941,2cyclictest31850-21grep23:15:121
277909941,2cyclictest31594-21if_lan20:35:141
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional