You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-07 - 20:14

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #8, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack8slot6s.osadl.org (updated Tue Apr 07, 2026 12:43:43)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
25877991818,0cyclictest65850irq/126-lan08:54:483
25877991817,1cyclictest65850irq/126-lan10:20:183
25877991817,1cyclictest65850irq/126-lan09:00:193
25877991717,0cyclictest65850irq/126-lan12:30:163
25877991717,0cyclictest65850irq/126-lan08:55:173
25877991716,1cyclictest65850irq/126-lan11:30:123
25877991716,1cyclictest65850irq/126-lan11:20:153
25877991716,1cyclictest65850irq/126-lan11:00:003
25877991716,1cyclictest65850irq/126-lan10:45:223
25877991716,1cyclictest65850irq/126-lan09:55:133
25877991716,1cyclictest65850irq/126-lan09:25:213
25877991716,1cyclictest65850irq/126-lan08:41:303
25877991716,1cyclictest65850irq/126-lan08:15:183
25877991716,1cyclictest65850irq/126-lan08:10:193
25877991716,1cyclictest65850irq/126-lan07:18:293
25877991616,0cyclictest65850irq/126-lan12:15:163
25877991616,0cyclictest65850irq/126-lan10:15:143
25877991616,0cyclictest65850irq/126-lan09:19:043
25877991616,0cyclictest65850irq/126-lan07:50:153
25877991616,0cyclictest65850irq/126-lan07:29:053
25877991615,1cyclictest65850irq/126-lan12:35:133
25877991615,1cyclictest65850irq/126-lan12:00:193
25877991615,1cyclictest65850irq/126-lan10:40:163
25877991615,1cyclictest65850irq/126-lan10:25:103
25877991615,1cyclictest65850irq/126-lan10:05:193
25877991615,1cyclictest65850irq/126-lan09:45:203
25877991615,1cyclictest65850irq/126-lan08:35:143
25877991615,1cyclictest65850irq/126-lan07:55:163
25877991615,1cyclictest65850irq/126-lan07:35:153
25877991515,0cyclictest65850irq/126-lan12:25:153
25877991515,0cyclictest65850irq/126-lan12:05:153
25877991515,0cyclictest65850irq/126-lan11:10:113
25877991515,0cyclictest65850irq/126-lan07:45:153
25877991514,1cyclictest65850irq/126-lan11:40:153
25877991514,1cyclictest65850irq/126-lan11:38:423
25877991514,1cyclictest65850irq/126-lan09:30:133
25877991514,1cyclictest65850irq/126-lan09:20:383
25877991514,1cyclictest65850irq/126-lan09:05:093
25877991514,1cyclictest65850irq/126-lan08:30:103
25877991514,1cyclictest65850irq/126-lan07:30:193
25877991414,0cyclictest65850irq/126-lan10:50:013
25877991413,1cyclictest65850irq/126-lan12:10:173
25877991413,1cyclictest65850irq/126-lan10:10:143
25877991413,1cyclictest65850irq/126-lan07:40:173
25877991413,1cyclictest65850irq/126-lan07:20:213
25872991414,0cyclictest743-21snmpd08:55:532
25877991313,0cyclictest65850irq/126-lan11:55:203
25877991313,0cyclictest65850irq/126-lan08:00:133
25877991312,1cyclictest65850irq/126-lan11:50:173
25877991312,1cyclictest65850irq/126-lan11:15:223
25877991312,1cyclictest65850irq/126-lan11:05:133
25877991312,1cyclictest65850irq/126-lan10:30:153
25877991312,1cyclictest65850irq/126-lan09:40:133
25877991312,1cyclictest65850irq/126-lan09:35:163
25877991312,1cyclictest65850irq/126-lan09:10:163
25872991313,0cyclictest743-21snmpd08:44:432
25877991211,1cyclictest65850irq/126-lan11:25:003
25877991211,1cyclictest65850irq/126-lan08:25:173
25877991211,1cyclictest65850irq/126-lan07:10:163
25872991212,0cyclictest743-21snmpd07:48:112
25872991212,0cyclictest743-21snmpd07:42:472
25877991111,0cyclictest65850irq/126-lan08:45:233
25877991110,1cyclictest65850irq/126-lan08:20:233
25872991111,0cyclictest743-21snmpd11:46:262
25872991111,0cyclictest743-21snmpd11:39:162
25872991111,0cyclictest743-21snmpd11:05:272
25872991111,0cyclictest743-21snmpd11:03:062
25872991111,0cyclictest743-21snmpd10:16:112
25872991111,0cyclictest743-21snmpd08:12:242
25872991111,0cyclictest743-21snmpd08:09:512
25872991111,0cyclictest743-21snmpd07:29:042
25872991111,0cyclictest20375-21cat08:15:142
25872991111,0cyclictest19116-21cat09:30:142
2587799109,1cyclictest65850irq/126-lan12:20:143
2587799109,1cyclictest65850irq/126-lan10:35:123
25872991010,0cyclictest743-21snmpd11:41:222
25872991010,0cyclictest743-21snmpd11:26:272
25872991010,0cyclictest743-21snmpd11:19:522
25872991010,0cyclictest743-21snmpd11:13:452
25872991010,0cyclictest743-21snmpd10:36:582
25872991010,0cyclictest743-21snmpd10:33:472
25872991010,0cyclictest743-21snmpd09:46:582
25872991010,0cyclictest743-21snmpd09:17:092
25872991010,0cyclictest743-21snmpd08:50:462
25872991010,0cyclictest743-21snmpd07:15:192
25872991010,0cyclictest17869-21cat10:45:152
25872991010,0cyclictest17106-21cat09:25:152
258779999,0cyclictest65850irq/126-lan10:00:203
258779998,1cyclictest65850irq/126-lan11:45:173
258779998,1cyclictest65850irq/126-lan11:00:133
258729999,0cyclictest743-21snmpd12:12:292
258729999,0cyclictest743-21snmpd10:13:582
258729999,0cyclictest743-21snmpd09:44:582
258729999,0cyclictest743-21snmpd08:48:282
258729999,0cyclictest743-21snmpd08:35:212
258729998,1cyclictest743-21snmpd08:33:152
258729998,1cyclictest741-21lldpd12:01:282
258729998,1cyclictest741-21lldpd10:52:342
258679998,1cyclictest743-21snmpd12:26:121
258679998,1cyclictest743-21snmpd09:54:511
258609998,1cyclictest743-21snmpd08:37:360
258609998,1cyclictest743-21snmpd07:28:220
258779987,1cyclictest65850irq/126-lan08:10:003
258729988,0cyclictest743-21snmpd12:21:302
258729988,0cyclictest743-21snmpd09:07:042
258729988,0cyclictest741-21lldpd07:11:202
258729987,1cyclictest743-21snmpd09:11:022
258729987,1cyclictest743-21snmpd07:50:032
258729987,1cyclictest743-21snmpd07:35:262
258729986,2cyclictest743-21snmpd11:21:312
258729986,2cyclictest743-21snmpd10:42:502
258729986,2cyclictest743-21snmpd10:01:042
258729986,2cyclictest743-21snmpd09:59:192
258679988,0cyclictest741-21lldpd10:01:401
258679988,0cyclictest741-21lldpd09:23:461
258679988,0cyclictest741-21lldpd09:16:351
258679987,1cyclictest743-21snmpd11:56:551
258679987,1cyclictest743-21snmpd10:57:531
258679987,1cyclictest743-21snmpd10:40:071
258679987,1cyclictest743-21snmpd08:40:431
258679987,1cyclictest743-21snmpd08:25:281
258679987,1cyclictest741-21lldpd07:32:351
258679986,2cyclictest743-21snmpd11:51:501
258679986,2cyclictest743-21snmpd11:08:421
258679986,2cyclictest743-21snmpd07:52:571
258679984,3cyclictest27292-21ntp_states08:30:161
258609988,0cyclictest743-21snmpd08:17:300
258609988,0cyclictest741-21lldpd07:33:070
258609987,1cyclictest743-21snmpd11:25:330
258609987,1cyclictest743-21snmpd10:24:470
258609987,1cyclictest743-21snmpd10:17:260
258609987,1cyclictest743-21snmpd09:52:120
258609987,1cyclictest743-21snmpd09:48:520
258609987,1cyclictest743-21snmpd08:21:330
258609987,1cyclictest743-21snmpd08:05:410
258609987,1cyclictest575-21rs:main0
258609986,2cyclictest743-21snmpd11:59:280
258609986,2cyclictest743-21snmpd11:21:370
258609986,2cyclictest729-21cron09:39:590
258609986,2cyclictest4088-21cat11:30:140
258609986,2cyclictest10300-21cat07:50:140
258779977,0cyclictest741-21lldpd09:51:253
258729977,0cyclictest743-21snmpd11:32:492
258729977,0cyclictest741-21lldpd09:37:182
258729977,0cyclictest522-21avahi-daemon07:24:372
258729976,1cyclictest743-21snmpd10:07:242
258729976,1cyclictest7134-21fschecks_count10:20:122
258729976,1cyclictest506-21systemd-resolve08:23:012
258729975,2cyclictest743-21snmpd09:02:372
258729975,2cyclictest12152-21cat11:50:142
258679977,0cyclictest743-21snmpd11:04:481
258679977,0cyclictest743-21snmpd09:56:521
258679977,0cyclictest741-21lldpd12:10:431
258679977,0cyclictest741-21lldpd11:41:481
258679977,0cyclictest741-21lldpd10:52:171
258679977,0cyclictest741-21lldpd08:11:401
258679977,0cyclictest741-21lldpd08:09:381
258679977,0cyclictest741-21lldpd07:38:061
258679976,1cyclictest743-21snmpd12:17:301
258679976,1cyclictest743-21snmpd08:04:321
258679976,1cyclictest3004-21kworker/1:0+events12:20:131
258679976,1cyclictest29987-21cat11:15:151
258679975,2cyclictest743-21snmpd11:31:581
258679975,2cyclictest743-21snmpd08:20:221
258609977,0cyclictest743-21snmpd10:11:300
258609977,0cyclictest743-21snmpd09:28:350
258609977,0cyclictest741-21lldpd12:26:060
258609977,0cyclictest741-21lldpd10:59:100
258609977,0cyclictest741-21lldpd09:43:580
258609977,0cyclictest741-21lldpd08:47:290
258609977,0cyclictest741-21lldpd08:10:020
258609977,0cyclictest741-21lldpd07:56:500
258609977,0cyclictest741-21lldpd07:41:040
258609977,0cyclictest741-21lldpd07:16:540
258609976,1cyclictest743-21snmpd11:52:110
258609976,1cyclictest522-21avahi-daemon07:14:450
258609973,3cyclictest19014-21grep12:05:210
258609972,5cyclictest557-21NetworkManager09:23:010
258729966,0cyclictest743-21snmpd12:05:202
258729966,0cyclictest522-21avahi-daemon07:55:482
258729963,2cyclictest27034-21ntpq12:25:162
258729961,4cyclictest244-20systemd-journal12:37:552
258679966,0cyclictest741-21lldpd11:20:311
258679966,0cyclictest741-21lldpd11:13:001
258679965,1cyclictest743-21snmpd12:04:261
258679965,1cyclictest743-21snmpd10:28:581
258679965,1cyclictest522-21avahi-daemon10:36:181
258679965,1cyclictest506-21systemd-resolve08:46:511
258679965,1cyclictest24835-21cpuspeed_turbos09:45:131
258679964,2cyclictest743-21snmpd11:36:581
258679964,2cyclictest743-21snmpd08:51:431
258679964,2cyclictest743-21snmpd07:22:561
258679964,1cyclictest743-21snmpd09:03:291
258679963,3cyclictest6399-21memory07:40:151
258679963,2cyclictest575-21rs:main1
258679962,3cyclictest8161-21grep10:20:201
258679962,3cyclictest18337-21memory12:05:151
258609966,0cyclictest743-21snmpd12:37:340
258609966,0cyclictest743-21snmpd11:49:080
258609966,0cyclictest743-21snmpd11:07:570
258609966,0cyclictest743-21snmpd09:02:230
258609966,0cyclictest743-21snmpd08:54:100
258609966,0cyclictest741-21lldpd11:02:570
258609965,1cyclictest743-21snmpd12:10:060
258609965,1cyclictest743-21snmpd10:40:310
258609965,1cyclictest743-21snmpd08:34:180
258609965,1cyclictest743-21snmpd08:28:280
258609965,1cyclictest10692-21cpuspeed_turbos09:10:120
258609964,2cyclictest743-21snmpd10:35:440
258609964,2cyclictest743-21snmpd07:39:020
258609962,3cyclictest23104-21smartctl12:15:180
258609961,4cyclictest29490-21cat11:14:590
258729955,0cyclictest741-21lldpd09:23:082
258729953,2cyclictest743-21snmpd09:50:572
258729953,2cyclictest717-21ntpd12:15:442
258729953,2cyclictest717-21ntpd10:26:322
258729952,2cyclictest3260-21seq07:32:172
258729951,3cyclictest13903-21diskstats11:55:122
258679955,0cyclictest8672-21cpuspeed_turbos09:05:091
258679955,0cyclictest741-21lldpd10:16:221
258679955,0cyclictest522-21avahi-daemon11:46:101
258679955,0cyclictest2950-21cpuspeed_turbos10:10:111
258679954,1cyclictest741-21lldpd07:45:351
258679954,1cyclictest522-21avahi-daemon09:30:081
258679954,1cyclictest28534-21fschecks_time12:30:121
258679953,2cyclictest743-21snmpd09:27:421
258679952,3cyclictest557-21NetworkManager09:10:321
258679952,2cyclictest30186-21grep08:35:201
258679952,2cyclictest29352-21sed07:15:201
258679952,2cyclictest244-20systemd-journal08:55:281
258679951,3cyclictest31670-21users12:35:211
258609954,1cyclictest743-21snmpd10:29:520
258609954,1cyclictest741-21lldpd11:15:130
258609954,1cyclictest522-21avahi-daemon10:07:080
258609954,1cyclictest13463-21ntp_states09:15:170
258609953,2cyclictest743-21snmpd10:53:510
258609953,2cyclictest743-21snmpd10:03:460
258609952,2cyclictest7670-21find11:40:110
258609952,2cyclictest5240-21netstat08:55:150
258609952,2cyclictest31974-21sed08:40:200
258609951,4cyclictest31962-21cat07:25:000
258609950,4cyclictest29629-21ntpq09:55:160
258609950,4cyclictest18181-21ntpq10:45:170
258609950,4cyclictest16529-21ntpq12:00:170
258609950,3cyclictest13140-21munin-run10:35:000
258729944,0cyclictest741-21lldpd12:30:082
258729943,1cyclictest411rcuc/208:00:122
258729943,1cyclictest24261-21fschecks_time08:25:132
258729940,3cyclictest21630-21diskstats10:55:132
258679943,1cyclictest32194-21cpuspeed_turbos07:25:111
258679942,2cyclictest34-21ksoftirqd/107:55:091
258679942,2cyclictest21280-21sed09:35:151
258679941,3cyclictest896-21irqstats10:05:131
258679941,2cyclictest26645-21missed_timers07:10:151
258679941,2cyclictest23440-21uname09:40:161
258679941,2cyclictest20604-21grep08:15:151
258679941,2cyclictest1947-21ld11:25:161
258679941,2cyclictest11143-21apt-key10:30:001
258609943,1cyclictest9367-21ntpq09:05:140
258609943,1cyclictest8656-21ntpq07:45:170
258609943,1cyclictest741-21lldpd12:20:260
258609942,2cyclictest28478-21entropy12:30:110
258609942,2cyclictest0-21swapper/011:35:110
258609941,2cyclictest18776-21expr09:30:120
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional