You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-10 - 07:43

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #8, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack8slot6s.osadl.org (updated Tue Mar 10, 2026 00:43:42)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
28037991918,1cyclictest65850irq/126-lan21:29:592
28037991818,0cyclictest65850irq/126-lan00:09:242
28037991817,1cyclictest65850irq/126-lan22:08:522
28037991817,1cyclictest65850irq/126-lan21:41:502
28037991817,1cyclictest65850irq/126-lan20:55:172
28037991817,1cyclictest65850irq/126-lan19:30:112
28037991817,1cyclictest65850irq/126-lan00:15:122
28037991817,1cyclictest65850irq/126-lan00:00:192
28037991717,0cyclictest65850irq/126-lan23:30:182
28037991717,0cyclictest65850irq/126-lan22:50:162
28037991717,0cyclictest65850irq/126-lan20:37:412
28037991717,0cyclictest65850irq/126-lan20:25:192
28037991717,0cyclictest65850irq/126-lan20:05:132
28037991716,1cyclictest65850irq/126-lan23:50:112
28037991716,1cyclictest65850irq/126-lan23:40:202
28037991716,1cyclictest65850irq/126-lan23:20:122
28037991716,1cyclictest65850irq/126-lan23:10:142
28037991716,1cyclictest65850irq/126-lan23:00:152
28037991716,1cyclictest65850irq/126-lan20:20:142
28037991716,1cyclictest65850irq/126-lan19:55:182
28037991716,1cyclictest65850irq/126-lan00:30:222
28037991615,1cyclictest65850irq/126-lan23:55:142
28037991615,1cyclictest65850irq/126-lan22:25:172
28037991615,1cyclictest65850irq/126-lan21:20:132
28037991615,1cyclictest65850irq/126-lan21:02:062
28037991615,1cyclictest65850irq/126-lan20:50:132
28037991615,1cyclictest65850irq/126-lan00:35:182
28037991515,0cyclictest65850irq/126-lan23:25:162
28037991515,0cyclictest65850irq/126-lan22:10:152
28037991515,0cyclictest65850irq/126-lan20:41:362
28037991515,0cyclictest65850irq/126-lan19:50:132
28037991514,1cyclictest65850irq/126-lan23:35:102
28037991514,1cyclictest65850irq/126-lan23:15:152
28037991514,1cyclictest65850irq/126-lan22:45:042
28037991514,1cyclictest65850irq/126-lan21:50:162
28037991514,1cyclictest65850irq/126-lan19:35:152
28037991514,1cyclictest65850irq/126-lan19:15:162
28037991514,1cyclictest65850irq/126-lan00:10:122
28037991413,1cyclictest65850irq/126-lan23:45:162
28037991413,1cyclictest65850irq/126-lan21:05:132
28037991413,1cyclictest65850irq/126-lan20:10:122
28037991413,1cyclictest65850irq/126-lan19:40:192
28037991413,1cyclictest65850irq/126-lan19:20:122
28037991313,0cyclictest65850irq/126-lan20:15:152
28037991313,0cyclictest65850irq/126-lan19:45:112
28037991313,0cyclictest65850irq/126-lan19:26:372
28037991312,1cyclictest65850irq/126-lan22:35:132
28037991312,1cyclictest65850irq/126-lan22:15:202
28037991312,1cyclictest65850irq/126-lan21:55:142
28037991312,1cyclictest65850irq/126-lan21:47:172
28037991312,1cyclictest65850irq/126-lan21:31:452
28037991312,1cyclictest65850irq/126-lan00:27:232
28037991312,1cyclictest65850irq/126-lan00:20:102
28037991212,0cyclictest65850irq/126-lan20:45:142
28037991211,1cyclictest65850irq/126-lan21:15:132
28037991111,0cyclictest65850irq/126-lan22:55:192
28037991111,0cyclictest65850irq/126-lan22:20:202
28037991111,0cyclictest65850irq/126-lan20:00:102
28037991111,0cyclictest65850irq/126-lan19:10:142
28037991110,1cyclictest65850irq/126-lan22:40:122
2803799109,1cyclictest65850irq/126-lan22:35:002
2803799109,1cyclictest65850irq/126-lan21:10:222
2803799109,1cyclictest65850irq/126-lan20:30:172
280419998,1cyclictest743-21snmpd23:58:453
280419998,1cyclictest743-21snmpd23:09:153
280419998,1cyclictest743-21snmpd21:41:273
280419998,1cyclictest741-21lldpd22:21:443
280379998,1cyclictest741-21lldpd22:02:162
280329998,1cyclictest743-21snmpd20:09:061
280329998,1cyclictest743-21snmpd19:54:321
280329998,1cyclictest741-21lldpd00:08:501
280249998,1cyclictest743-21snmpd23:53:520
280249998,1cyclictest743-21snmpd23:05:270
280249998,1cyclictest743-21snmpd20:59:130
280249998,1cyclictest741-21lldpd21:17:510
280419988,0cyclictest743-21snmpd22:11:073
280419988,0cyclictest741-21lldpd23:19:233
280419988,0cyclictest741-21lldpd19:23:223
280419987,1cyclictest743-21snmpd22:45:383
280419987,1cyclictest522-21avahi-daemon22:50:223
280419987,1cyclictest522-21avahi-daemon20:50:003
280419986,2cyclictest743-21snmpd23:21:393
280419986,2cyclictest743-21snmpd23:12:573
280419986,2cyclictest743-21snmpd22:44:233
280419986,2cyclictest743-21snmpd21:49:273
280419986,2cyclictest743-21snmpd21:15:113
280419986,2cyclictest743-21snmpd20:00:043
280419986,2cyclictest743-21snmpd00:37:393
280329988,0cyclictest743-21snmpd22:21:341
280329988,0cyclictest743-21snmpd22:01:481
280329988,0cyclictest743-21snmpd20:57:521
280329988,0cyclictest743-21snmpd20:52:581
280329988,0cyclictest743-21snmpd20:47:251
280329988,0cyclictest743-21snmpd20:04:171
280329988,0cyclictest741-21lldpd23:45:231
280329988,0cyclictest741-21lldpd20:25:301
280329988,0cyclictest741-21lldpd19:46:161
280329988,0cyclictest741-21lldpd19:31:381
280329987,1cyclictest743-21snmpd23:06:451
280329987,1cyclictest743-21snmpd21:38:481
280329987,1cyclictest743-21snmpd19:40:501
280329987,1cyclictest25026-21fschecks_count21:40:131
280329986,2cyclictest743-21snmpd22:19:041
280329986,2cyclictest743-21snmpd20:12:151
280329986,2cyclictest31245-21cat00:30:161
280249988,0cyclictest743-21snmpd20:45:040
280249988,0cyclictest743-21snmpd19:28:070
280249988,0cyclictest743-21snmpd00:20:590
280249988,0cyclictest741-21lldpd23:33:550
280249988,0cyclictest741-21lldpd20:22:260
280249988,0cyclictest717-21ntpd00:10:130
280249987,1cyclictest741-21lldpd23:39:090
280249987,1cyclictest25569-21ntp_kernel_err21:40:160
280249986,2cyclictest743-21snmpd22:34:080
280249986,2cyclictest743-21snmpd22:15:280
280249986,2cyclictest743-21snmpd19:23:400
280249984,1cyclictest19557-21ntpq21:25:160
280419977,0cyclictest743-21snmpd20:30:003
280419977,0cyclictest741-21lldpd23:41:123
280419977,0cyclictest741-21lldpd20:41:113
280419976,1cyclictest743-21snmpd19:36:023
280419976,1cyclictest743-21snmpd00:21:413
280419976,1cyclictest743-21snmpd00:18:563
280419976,1cyclictest717-21ntpd22:35:193
280419976,1cyclictest717-21ntpd21:00:163
280419976,1cyclictest13873-21cpuspeed_turbos23:50:113
280419976,1cyclictest12128-21gltestperf23:45:133
280419975,2cyclictest743-21snmpd23:26:553
280419975,2cyclictest743-21snmpd22:15:073
280419975,2cyclictest743-21snmpd22:06:583
280419975,2cyclictest743-21snmpd21:25:083
280419975,2cyclictest743-21snmpd21:11:503
280419975,2cyclictest743-21snmpd19:46:373
280419975,2cyclictest717-21ntpd21:30:183
280419975,2cyclictest717-21ntpd20:05:193
280419975,2cyclictest717-21ntpd00:10:013
280419975,1cyclictest743-21snmpd00:05:023
280379976,1cyclictest65850irq/126-lan23:05:142
280329977,0cyclictest743-21snmpd19:25:521
280329977,0cyclictest741-21lldpd23:36:271
280329977,0cyclictest741-21lldpd23:21:311
280329977,0cyclictest741-21lldpd21:27:491
280329977,0cyclictest741-21lldpd19:15:201
280329977,0cyclictest741-21lldpd00:27:541
280329976,1cyclictest743-21snmpd19:56:051
280329976,1cyclictest743-21snmpd19:10:551
280329976,1cyclictest741-21lldpd21:06:071
280329975,2cyclictest743-21snmpd23:34:461
280329975,2cyclictest743-21snmpd23:14:331
280329975,2cyclictest743-21snmpd19:23:431
280329975,2cyclictest743-21snmpd00:15:331
280249977,0cyclictest743-21snmpd22:43:470
280249977,0cyclictest743-21snmpd22:38:140
280249977,0cyclictest743-21snmpd21:10:320
280249977,0cyclictest741-21lldpd23:14:530
280249977,0cyclictest741-21lldpd22:54:210
280249977,0cyclictest741-21lldpd22:10:250
280249977,0cyclictest741-21lldpd21:22:010
280249977,0cyclictest741-21lldpd00:35:540
280249976,1cyclictest522-21avahi-daemon19:59:450
280249976,1cyclictest29303-21cat21:50:140
280249975,2cyclictest743-21snmpd21:59:570
280249975,2cyclictest743-21snmpd21:07:560
280419966,0cyclictest743-21snmpd22:26:313
280419966,0cyclictest743-21snmpd20:55:013
280419966,0cyclictest741-21lldpd22:31:543
280419966,0cyclictest741-21lldpd21:06:513
280419965,1cyclictest743-21snmpd00:00:083
280419965,1cyclictest717-21ntpd22:55:213
280419965,1cyclictest30460-21fschecks_time19:15:133
280419964,2cyclictest743-21snmpd21:20:173
280419964,2cyclictest743-21snmpd20:36:223
280419964,2cyclictest743-21snmpd20:22:153
280419964,2cyclictest743-21snmpd20:17:123
280419963,3cyclictest743-21snmpd00:26:243
280419963,3cyclictest557-21NetworkManager21:39:263
280379962,3cyclictest23330-21sed21:35:152
280329966,0cyclictest743-21snmpd22:54:351
280329966,0cyclictest743-21snmpd21:15:291
280329966,0cyclictest743-21snmpd20:16:481
280329966,0cyclictest741-21lldpd23:55:581
280329966,0cyclictest741-21lldpd21:49:041
280329965,1cyclictest743-21snmpd22:43:151
280329965,1cyclictest2645-21kworker/1:1+events00:23:181
280329963,3cyclictest12463-21df21:10:141
280249966,0cyclictest743-21snmpd23:15:420
280249966,0cyclictest741-21lldpd22:25:010
280249966,0cyclictest741-21lldpd22:05:580
280249966,0cyclictest741-21lldpd20:25:080
280249966,0cyclictest522-21avahi-daemon19:19:470
280249965,1cyclictest743-21snmpd23:29:370
280249965,1cyclictest743-21snmpd22:46:350
280249965,1cyclictest743-21snmpd21:33:530
280249965,1cyclictest743-21snmpd19:51:320
280249965,1cyclictest24773-21cat00:15:150
280249965,1cyclictest16640-21needreboot20:00:140
280249964,2cyclictest743-21snmpd23:47:160
280249964,2cyclictest743-21snmpd22:00:330
280249964,2cyclictest743-21snmpd21:02:580
280249964,2cyclictest743-21snmpd20:41:010
280249964,2cyclictest743-21snmpd19:33:160
280249964,2cyclictest743-21snmpd00:02:240
280249964,2cyclictest17571-21systemctl00:00:000
280249962,3cyclictest743-21snmpd19:35:100
280419955,0cyclictest743-21snmpd19:29:163
280419955,0cyclictest522-21avahi-daemon19:44:473
280419955,0cyclictest0-21swapper/319:50:133
280419954,1cyclictest743-21snmpd20:27:543
280419954,1cyclictest5524-21unixbench_multi20:50:223
280419954,1cyclictest0-21swapper/323:30:173
280419953,2cyclictest717-21ntpd19:30:003
280419952,3cyclictest557-21NetworkManager21:50:163
280419952,2cyclictest575-21rs:main3
280419952,2cyclictest1123-21ls22:00:153
280419951,3cyclictest21149-21grep20:10:203
280419950,5cyclictest557-21NetworkManager23:00:543
280419950,4cyclictest31664-21ntpq00:30:183
280329955,0cyclictest743-21snmpd20:44:221
280329955,0cyclictest741-21lldpd19:39:141
280329954,1cyclictest9985-21fschecks_count23:40:121
280329954,1cyclictest741-21lldpd23:00:571
280329954,1cyclictest28422-21gltestperf20:30:131
280329953,2cyclictest743-21snmpd22:07:341
280329953,2cyclictest743-21snmpd21:30:201
280329952,3cyclictest557-21NetworkManager21:56:191
280329951,3cyclictest24057-21ls22:55:141
280329951,3cyclictest18038-21diskstats00:00:121
280329950,5cyclictest5041-21idleruntime-cro23:30:001
280249955,0cyclictest741-21lldpd23:42:050
280249955,0cyclictest741-21lldpd20:15:040
280249954,1cyclictest522-21avahi-daemon19:40:130
280249954,1cyclictest23603-21ntpq21:35:170
280249953,2cyclictest743-21snmpd22:55:500
280249953,2cyclictest743-21snmpd22:20:100
280249953,2cyclictest743-21snmpd00:07:290
280249953,2cyclictest557-21NetworkManager20:06:150
280249953,2cyclictest28246-21tr20:30:120
280249953,0cyclictest557-21NetworkManager23:03:300
280249952,2cyclictest3546-21apt-get20:50:000
280249952,2cyclictest29384-21cat19:10:240
280249952,2cyclictest10849-21smartctl19:45:180
280419943,1cyclictest29052-21ntpq19:10:213
280419942,2cyclictest14573-21sed19:55:153
280419941,2cyclictest31422-21cat21:55:143
280329944,0cyclictest741-21lldpd20:36:211
280329943,1cyclictest22047-21df00:10:121
280329943,1cyclictest13873-21cpuspeed_turbos23:50:111
280329943,1cyclictest0-21swapper/123:15:201
280329942,2cyclictest717-21ntpd21:50:121
280329941,2cyclictest575-21rs:main1
280329941,2cyclictest11031-21cat22:25:111
280329940,4cyclictest8376-21cut21:00:101
280329940,4cyclictest13789-21ntpq22:30:161
280329940,3cyclictest5835-21ntp_states22:10:181
280329940,3cyclictest20321-21ntpq22:45:191
280329940,3cyclictest16777-21apt-get21:20:101
280329940,3cyclictest15660-21diskstats22:35:121
280329940,3cyclictest1291-21ntp_states00:35:181
280249942,2cyclictest27744-21cut21:45:210
280249941,3cyclictest743-21snmpd20:10:120
280249941,2cyclictest30794-21tail20:35:160
280249941,2cyclictest29817-21mailstats00:25:190
280249940,0cyclictest0-21swapper/023:20:200
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional