You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-26 - 12:40

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #8, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack8slot6s.osadl.org (updated Tue May 26, 2026 00:43:43)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
21869992018,2cyclictest65850irq/126-lan20:05:131
21869991918,1cyclictest65850irq/126-lan19:55:091
21869991918,1cyclictest65850irq/126-lan19:20:201
21869991918,1cyclictest65850irq/126-lan00:35:221
21869991818,0cyclictest65850irq/126-lan21:53:281
21869991817,1cyclictest65850irq/126-lan23:55:201
21869991817,1cyclictest65850irq/126-lan23:09:281
21869991817,1cyclictest65850irq/126-lan22:45:151
21869991817,1cyclictest65850irq/126-lan22:05:201
21869991817,1cyclictest65850irq/126-lan22:02:521
21869991817,1cyclictest65850irq/126-lan00:00:221
21869991816,2cyclictest65850irq/126-lan23:15:211
21869991816,2cyclictest65850irq/126-lan21:15:131
21869991816,2cyclictest65850irq/126-lan20:20:211
21869991816,2cyclictest65850irq/126-lan19:35:171
21869991816,2cyclictest65850irq/126-lan00:15:181
21869991717,0cyclictest65850irq/126-lan00:13:301
21869991716,1cyclictest65850irq/126-lan23:40:121
21869991716,1cyclictest65850irq/126-lan21:40:141
21869991716,1cyclictest65850irq/126-lan19:40:191
21869991715,2cyclictest65850irq/126-lan20:54:111
21869991715,2cyclictest65850irq/126-lan19:34:281
21869991715,2cyclictest65850irq/126-lan19:34:281
21869991616,0cyclictest65850irq/126-lan23:30:161
21869991616,0cyclictest65850irq/126-lan21:35:181
21869991616,0cyclictest65850irq/126-lan20:30:141
21869991616,0cyclictest65850irq/126-lan19:46:471
21869991615,1cyclictest65850irq/126-lan22:55:201
21869991614,2cyclictest65850irq/126-lan22:19:261
21869991613,3cyclictest65850irq/126-lan20:25:191
21869991613,1cyclictest65850irq/126-lan21:25:141
21865991616,0cyclictest743-21snmpd22:59:480
21869991515,0cyclictest65850irq/126-lan23:45:131
21869991515,0cyclictest65850irq/126-lan21:20:181
21869991514,1cyclictest65850irq/126-lan22:50:151
21869991514,1cyclictest65850irq/126-lan22:35:141
21869991514,1cyclictest65850irq/126-lan21:55:151
21869991514,1cyclictest65850irq/126-lan21:34:221
21869991514,1cyclictest65850irq/126-lan20:36:541
21869991514,1cyclictest65850irq/126-lan20:00:211
21869991514,1cyclictest65850irq/126-lan19:26:381
21869991513,2cyclictest65850irq/126-lan23:35:131
21869991513,2cyclictest65850irq/126-lan22:20:211
21869991512,1cyclictest65850irq/126-lan22:30:171
21865991515,0cyclictest743-21snmpd22:21:020
21865991515,0cyclictest743-21snmpd00:30:400
21869991414,0cyclictest65850irq/126-lan23:25:201
21869991414,0cyclictest65850irq/126-lan23:20:141
21869991414,0cyclictest65850irq/126-lan21:47:291
21869991414,0cyclictest65850irq/126-lan20:45:001
21869991414,0cyclictest65850irq/126-lan19:15:211
21869991414,0cyclictest65850irq/126-lan00:30:171
21869991414,0cyclictest65850irq/126-lan00:26:281
21869991414,0cyclictest65850irq/126-lan00:20:281
21869991413,1cyclictest65850irq/126-lan22:10:201
21869991413,1cyclictest65850irq/126-lan20:55:281
21865991414,0cyclictest743-21snmpd21:20:390
21869991313,0cyclictest65850irq/126-lan23:00:181
21869991313,0cyclictest65850irq/126-lan21:10:131
21869991313,0cyclictest65850irq/126-lan21:01:281
21869991312,1cyclictest65850irq/126-lan23:10:111
21869991312,1cyclictest65850irq/126-lan22:25:141
21869991312,1cyclictest65850irq/126-lan20:16:531
21865991313,0cyclictest743-21snmpd23:55:020
21865991313,0cyclictest743-21snmpd23:01:420
21865991313,0cyclictest743-21snmpd21:12:540
21865991313,0cyclictest743-21snmpd19:58:210
21865991313,0cyclictest743-21snmpd19:26:260
21865991313,0cyclictest21147-21cat00:20:140
21869991211,1cyclictest65850irq/126-lan22:40:181
21869991211,1cyclictest65850irq/126-lan20:10:211
21869991211,1cyclictest65850irq/126-lan00:05:141
21865991212,0cyclictest8568-21cat23:50:140
21865991212,0cyclictest743-21snmpd23:38:230
21865991212,0cyclictest743-21snmpd22:12:280
21865991212,0cyclictest743-21snmpd22:08:040
21865991212,0cyclictest743-21snmpd21:59:340
21865991212,0cyclictest743-21snmpd21:38:450
21865991212,0cyclictest743-21snmpd21:28:330
21865991212,0cyclictest743-21snmpd21:06:080
21865991212,0cyclictest743-21snmpd21:02:200
21865991212,0cyclictest743-21snmpd20:32:100
21865991212,0cyclictest743-21snmpd19:32:170
21865991212,0cyclictest743-21snmpd19:32:160
21865991212,0cyclictest743-21snmpd00:11:090
21865991212,0cyclictest743-21snmpd00:06:080
21865991212,0cyclictest743-21snmpd00:02:050
21865991212,0cyclictest23185-21cat00:25:150
21869991111,0cyclictest65850irq/126-lan20:40:111
21869991111,0cyclictest65850irq/126-lan19:50:211
21869991110,1cyclictest65850irq/126-lan19:10:111
21865991111,0cyclictest743-21snmpd23:30:340
21865991111,0cyclictest743-21snmpd23:20:400
21865991111,0cyclictest743-21snmpd22:49:210
21865991111,0cyclictest743-21snmpd22:15:170
21865991111,0cyclictest743-21snmpd21:48:310
21865991111,0cyclictest743-21snmpd20:24:580
21865991111,0cyclictest743-21snmpd19:44:030
21865991111,0cyclictest27190-21cat00:35:140
21865991111,0cyclictest21964-21cat23:05:130
21869991010,0cyclictest65850irq/126-lan23:50:281
21869991010,0cyclictest65850irq/126-lan21:06:281
218799998,1cyclictest743-21snmpd21:31:063
218799998,1cyclictest743-21snmpd20:52:593
218799998,1cyclictest741-21lldpd22:03:033
218799998,1cyclictest741-21lldpd20:26:383
218799997,2cyclictest506-21systemd-resolve20:35:293
218739998,1cyclictest743-21snmpd21:25:212
218739998,1cyclictest741-21lldpd19:52:242
218799988,0cyclictest743-21snmpd22:18:203
218799988,0cyclictest743-21snmpd21:59:373
218799988,0cyclictest741-21lldpd23:47:533
218799988,0cyclictest741-21lldpd00:05:133
218799987,1cyclictest743-21snmpd22:27:263
218799987,1cyclictest743-21snmpd20:57:383
218799987,1cyclictest743-21snmpd19:58:483
218799987,1cyclictest743-21snmpd19:49:303
218799987,1cyclictest743-21snmpd19:17:043
218799987,1cyclictest741-21lldpd23:31:253
218799987,1cyclictest741-21lldpd23:24:453
218799987,1cyclictest741-21lldpd22:10:503
218799987,1cyclictest741-21lldpd20:15:413
218799986,2cyclictest743-21snmpd23:57:093
218799986,2cyclictest743-21snmpd23:39:593
218799986,2cyclictest743-21snmpd22:48:213
218799986,2cyclictest743-21snmpd21:54:333
218799986,2cyclictest743-21snmpd20:22:253
218799986,2cyclictest743-21snmpd20:01:243
218799986,2cyclictest743-21snmpd19:42:523
218799986,2cyclictest743-21snmpd19:14:383
218799986,2cyclictest19443-21gltestperf23:00:133
218739988,0cyclictest743-21snmpd20:07:272
218739988,0cyclictest741-21lldpd19:21:012
218739986,2cyclictest743-21snmpd23:06:242
218739986,2cyclictest743-21snmpd20:27:042
218739986,2cyclictest743-21snmpd19:19:372
218739986,2cyclictest25414-21head00:30:142
218659988,0cyclictest743-21snmpd19:13:560
218659988,0cyclictest741-21lldpd23:17:310
218659986,2cyclictest743-21snmpd22:01:340
218659986,2cyclictest743-21snmpd21:44:220
218659986,2cyclictest743-21snmpd20:51:310
218799977,0cyclictest743-21snmpd23:52:563
218799977,0cyclictest743-21snmpd21:47:313
218799977,0cyclictest743-21snmpd21:43:373
218799977,0cyclictest741-21lldpd23:08:163
218799977,0cyclictest741-21lldpd22:51:023
218799977,0cyclictest741-21lldpd19:20:393
218799976,1cyclictest522-21avahi-daemon00:23:503
218799976,1cyclictest13960-21cpuspeed_turbos20:10:123
218799975,2cyclictest743-21snmpd21:36:243
218799975,2cyclictest743-21snmpd19:50:063
218799975,2cyclictest743-21snmpd19:35:143
218799975,2cyclictest743-21snmpd00:04:233
218799975,2cyclictest10673-21cat21:20:153
218739977,0cyclictest743-21snmpd23:10:492
218739977,0cyclictest743-21snmpd22:36:352
218739977,0cyclictest743-21snmpd20:38:102
218739977,0cyclictest741-21lldpd22:14:202
218739977,0cyclictest741-21lldpd21:40:032
218739977,0cyclictest741-21lldpd21:30:472
218739977,0cyclictest741-21lldpd19:44:012
218739977,0cyclictest741-21lldpd19:31:112
218739977,0cyclictest741-21lldpd19:31:112
218739977,0cyclictest741-21lldpd00:08:132
218739977,0cyclictest522-21avahi-daemon19:29:282
218739976,1cyclictest8163-21gltestperf19:55:132
218739976,1cyclictest743-21snmpd23:17:342
218739976,1cyclictest743-21snmpd21:20:062
218739976,1cyclictest743-21snmpd21:15:572
218739976,1cyclictest32649-21needreboot23:30:142
218739975,2cyclictest743-21snmpd23:21:462
218739975,2cyclictest743-21snmpd20:55:082
218739975,2cyclictest743-21snmpd19:12:072
218739975,2cyclictest743-21snmpd00:10:392
218739974,3cyclictest18547-21fw_conntrack00:15:142
218659977,0cyclictest743-21snmpd23:42:260
218659977,0cyclictest743-21snmpd22:34:530
218659977,0cyclictest741-21lldpd22:51:100
218659977,0cyclictest741-21lldpd20:40:480
218659977,0cyclictest741-21lldpd19:24:200
218659977,0cyclictest741-21lldpd19:18:410
218659976,1cyclictest743-21snmpd21:19:540
218659976,1cyclictest743-21snmpd20:06:150
218659976,1cyclictest743-21snmpd20:04:080
218659975,2cyclictest743-21snmpd21:32:060
218659975,2cyclictest743-21snmpd20:46:500
218799966,0cyclictest743-21snmpd22:44:033
218799966,0cyclictest743-21snmpd22:35:413
218799966,0cyclictest741-21lldpd21:26:073
218799965,1cyclictest743-21snmpd20:33:483
218799965,1cyclictest741-21lldpd20:47:013
218799965,1cyclictest23602-21cpuspeed_turbos23:10:113
218799964,2cyclictest743-21snmpd00:26:033
218799963,2cyclictest557-21NetworkManager23:42:203
218739966,0cyclictest9894-21latency_hist23:55:002
218739966,0cyclictest743-21snmpd20:54:202
218739966,0cyclictest741-21lldpd22:59:322
218739966,0cyclictest741-21lldpd22:54:422
218739966,0cyclictest741-21lldpd21:35:362
218739966,0cyclictest741-21lldpd21:06:372
218739966,0cyclictest1504-21cron19:40:012
218739965,1cyclictest743-21snmpd22:30:262
218739965,1cyclictest743-21snmpd22:19:382
218739965,1cyclictest743-21snmpd22:06:042
218739965,1cyclictest743-21snmpd21:51:372
218739964,2cyclictest743-21snmpd20:40:312
218739964,2cyclictest743-21snmpd20:22:402
218739964,2cyclictest743-21snmpd00:36:132
218739963,2cyclictest15891-21awk20:15:112
218739962,4cyclictest557-21NetworkManager22:49:132
218659966,0cyclictest741-21lldpd23:26:250
218659965,1cyclictest741-21lldpd19:36:430
218659965,1cyclictest506-21systemd-resolve19:50:220
218659964,2cyclictest6573-21cat23:45:140
218799955,0cyclictest741-21lldpd22:07:523
218799955,0cyclictest741-21lldpd19:31:393
218799955,0cyclictest741-21lldpd19:31:383
218799954,1cyclictest743-21snmpd22:34:143
218799954,1cyclictest743-21snmpd22:22:023
218799954,1cyclictest743-21snmpd19:28:083
218799954,1cyclictest522-21avahi-daemon23:18:523
218799953,2cyclictest743-21snmpd00:38:313
218799952,3cyclictest6188-21dpkg21:10:103
218799952,3cyclictest557-21NetworkManager00:31:073
218799952,2cyclictest26667-21grep20:40:143
218799952,2cyclictest244-20systemd-journal20:06:053
218799951,2cyclictest8869-21head21:15:163
218739954,1cyclictest743-21snmpd23:38:322
218739954,1cyclictest5860-21sh23:45:012
218739954,1cyclictest522-21avahi-daemon00:20:102
218739954,1cyclictest25083-21gltestperf21:55:152
218739954,1cyclictest13095-21nvmesmart_nvme000:00:182
218739954,1cyclictest0-21swapper/222:20:202
218739952,3cyclictest11550-21seq20:04:242
218739952,2cyclictest575-21rs:main2
218739952,2cyclictest4880-21sed22:25:142
218739952,2cyclictest2546-21hddtemp_smartct21:00:142
218739952,2cyclictest22769-21grep00:25:132
218739951,4cyclictest557-21NetworkManager21:48:222
218739951,3cyclictest30572-21memory23:25:152
218659955,0cyclictest522-21avahi-daemon22:25:510
218659955,0cyclictest522-21avahi-daemon20:58:060
218659954,1cyclictest522-21avahi-daemon20:35:510
218659953,2cyclictest717-21ntpd23:13:090
218659953,2cyclictest20396-21cat20:25:160
218659952,2cyclictest11305-21ntp_kernel_err22:40:170
218659952,1cyclictest20142-21cat00:20:000
218659951,3cyclictest9099-21memory22:35:140
218799942,2cyclictest17275-21uniq22:55:123
218799941,2cyclictest5417-21grep21:05:223
218799941,2cyclictest30749-21ntpq23:25:163
218799941,2cyclictest2380-21fschecks_count21:00:133
218799940,3cyclictest18989-21ntpq00:15:173
218739942,2cyclictest6805-21needreboot21:10:142
218739942,2cyclictest26519-21cron22:00:002
218739941,3cyclictest6288-21df_inode23:45:122
218739941,3cyclictest20816-21latency_hist23:05:002
218739941,2cyclictest3869-21cpuspeed_turbos19:45:122
218739941,2cyclictest28208-21awk20:45:132
218739941,2cyclictest14155-21cut20:10:132
218739941,2cyclictest10917-21grep22:40:142
218659942,2cyclictest4171-21tail19:45:120
218659942,2cyclictest22979-21grep21:50:120
218659941,2cyclictest16115-21cut20:15:140
218659941,2cyclictest13978-21tr20:10:120
218799930,2cyclictest16239-21awk00:10:103
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional