You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-25 - 00:34

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #8, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack8slot6s.osadl.org (updated Sun May 24, 2026 12:43:42)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3952991817,1cyclictest65850irq/126-lan10:45:151
3952991817,1cyclictest65850irq/126-lan10:10:111
3952991817,1cyclictest65850irq/126-lan09:20:121
3952991817,1cyclictest65850irq/126-lan08:46:161
3952991717,0cyclictest65850irq/126-lan12:08:371
3952991717,0cyclictest65850irq/126-lan10:35:141
3952991717,0cyclictest65850irq/126-lan08:25:151
3952991717,0cyclictest65850irq/126-lan08:15:201
3952991716,1cyclictest65850irq/126-lan12:00:201
3952991716,1cyclictest65850irq/126-lan11:25:181
3952991716,1cyclictest65850irq/126-lan11:20:161
3952991716,1cyclictest65850irq/126-lan10:50:131
3952991716,1cyclictest65850irq/126-lan09:05:211
3952991716,1cyclictest65850irq/126-lan08:05:181
3952991715,1cyclictest65850irq/126-lan11:40:111
3952991616,0cyclictest65850irq/126-lan11:00:171
3952991616,0cyclictest65850irq/126-lan09:45:431
3952991616,0cyclictest65850irq/126-lan09:32:161
3952991615,1cyclictest65850irq/126-lan11:55:121
3952991615,1cyclictest65850irq/126-lan11:10:201
3952991615,1cyclictest65850irq/126-lan10:00:131
3952991615,1cyclictest65850irq/126-lan08:40:161
3952991615,1cyclictest65850irq/126-lan08:30:131
3952991615,1cyclictest65850irq/126-lan07:50:141
3952991615,1cyclictest65850irq/126-lan07:30:141
3952991615,1cyclictest65850irq/126-lan07:20:181
3952991515,0cyclictest65850irq/126-lan10:59:161
3952991515,0cyclictest65850irq/126-lan09:35:211
3952991515,0cyclictest65850irq/126-lan08:20:141
3952991515,0cyclictest65850irq/126-lan08:00:191
3952991515,0cyclictest65850irq/126-lan07:29:231
3952991514,1cyclictest65850irq/126-lan12:30:161
3952991514,1cyclictest65850irq/126-lan10:40:171
3952991514,1cyclictest65850irq/126-lan08:55:181
3952991514,1cyclictest65850irq/126-lan07:40:131
3952991414,0cyclictest65850irq/126-lan12:13:161
3952991414,0cyclictest65850irq/126-lan11:35:111
3952991414,0cyclictest65850irq/126-lan11:15:151
3952991414,0cyclictest65850irq/126-lan10:15:161
3952991414,0cyclictest65850irq/126-lan09:58:021
3952991414,0cyclictest65850irq/126-lan09:50:171
3952991313,0cyclictest65850irq/126-lan11:31:151
3952991313,0cyclictest65850irq/126-lan10:29:161
3952991313,0cyclictest65850irq/126-lan10:20:171
3952991313,0cyclictest65850irq/126-lan09:10:131
3952991313,0cyclictest65850irq/126-lan07:39:411
3952991312,1cyclictest65850irq/126-lan11:05:221
3952991312,1cyclictest65850irq/126-lan09:40:171
3952991212,0cyclictest65850irq/126-lan12:35:331
3952991212,0cyclictest65850irq/126-lan12:25:201
3952991212,0cyclictest65850irq/126-lan12:20:161
3952991212,0cyclictest65850irq/126-lan09:15:181
3952991212,0cyclictest65850irq/126-lan09:03:151
3952991212,0cyclictest65850irq/126-lan08:10:191
3952991211,1cyclictest65850irq/126-lan07:14:181
3945991212,0cyclictest743-21snmpd11:29:410
3952991111,0cyclictest65850irq/126-lan11:51:161
3952991111,0cyclictest65850irq/126-lan08:38:161
3952991111,0cyclictest65850irq/126-lan07:55:131
3952991111,0cyclictest65850irq/126-lan07:45:181
3952991110,1cyclictest65850irq/126-lan11:50:001
3952991110,1cyclictest65850irq/126-lan10:05:131
3952991110,1cyclictest65850irq/126-lan09:25:131
3952991110,1cyclictest65850irq/126-lan07:20:001
3945991111,0cyclictest743-21snmpd10:05:180
3952991010,0cyclictest65850irq/126-lan10:32:161
3952991010,0cyclictest65850irq/126-lan08:50:141
39629998,1cyclictest743-21snmpd09:11:473
39579998,1cyclictest743-21snmpd12:05:402
39579998,1cyclictest743-21snmpd09:47:052
39579998,1cyclictest743-21snmpd08:33:152
39579998,1cyclictest741-21lldpd12:27:112
39579998,1cyclictest741-21lldpd11:11:122
39459999,0cyclictest743-21snmpd12:13:430
39459999,0cyclictest743-21snmpd10:42:380
39459998,1cyclictest743-21snmpd10:59:190
39459998,1cyclictest743-21snmpd10:22:540
39459998,1cyclictest743-21snmpd08:52:230
39459998,1cyclictest743-21snmpd08:33:120
39459998,1cyclictest743-21snmpd07:43:030
39459998,1cyclictest741-21lldpd12:26:510
39459998,1cyclictest741-21lldpd12:06:110
39459998,1cyclictest741-21lldpd09:10:340
39459998,1cyclictest741-21lldpd08:57:260
39629988,0cyclictest743-21snmpd12:39:083
39629988,0cyclictest743-21snmpd07:29:283
39629988,0cyclictest741-21lldpd12:24:313
39629988,0cyclictest741-21lldpd12:06:333
39629988,0cyclictest741-21lldpd11:36:323
39629987,1cyclictest743-21snmpd10:57:023
39629987,1cyclictest743-21snmpd09:55:373
39629986,2cyclictest743-21snmpd10:25:553
39629986,2cyclictest743-21snmpd07:23:533
39629984,2cyclictest0-21swapper/308:40:143
39579988,0cyclictest743-21snmpd10:23:102
39579988,0cyclictest743-21snmpd10:19:282
39579988,0cyclictest741-21lldpd11:30:182
39579988,0cyclictest741-21lldpd08:00:232
39579987,1cyclictest743-21snmpd11:42:242
39579987,1cyclictest743-21snmpd08:15:492
39579987,1cyclictest741-21lldpd08:08:352
39579987,1cyclictest522-21avahi-daemon07:15:202
39579986,2cyclictest743-21snmpd12:37:412
39579986,2cyclictest743-21snmpd11:38:212
39579986,2cyclictest743-21snmpd10:02:132
39579986,2cyclictest717-21ntpd12:01:212
39579986,2cyclictest717-21ntpd09:01:162
39579986,2cyclictest717-21ntpd08:45:292
39579986,2cyclictest18764-21cat07:45:142
39579983,5cyclictest557-21NetworkManager08:26:252
39529988,0cyclictest65850irq/126-lan12:15:131
39459988,0cyclictest743-21snmpd11:57:160
39459988,0cyclictest743-21snmpd11:53:400
39459988,0cyclictest743-21snmpd11:09:570
39459988,0cyclictest743-21snmpd11:04:050
39459988,0cyclictest743-21snmpd09:59:160
39459988,0cyclictest743-21snmpd09:48:420
39459988,0cyclictest743-21snmpd08:45:210
39459988,0cyclictest741-21lldpd12:39:190
39459988,0cyclictest741-21lldpd08:11:540
39459988,0cyclictest741-21lldpd07:25:200
39459987,1cyclictest743-21snmpd07:31:190
39459987,1cyclictest743-21snmpd07:15:460
39459986,2cyclictest743-21snmpd11:41:270
39459986,2cyclictest743-21snmpd11:31:360
39459986,2cyclictest743-21snmpd08:26:400
39629977,0cyclictest743-21snmpd12:31:173
39629977,0cyclictest743-21snmpd12:03:493
39629977,0cyclictest743-21snmpd11:21:333
39629977,0cyclictest743-21snmpd11:17:063
39629977,0cyclictest743-21snmpd09:44:093
39629977,0cyclictest743-21snmpd08:20:223
39629977,0cyclictest743-21snmpd08:18:133
39629977,0cyclictest743-21snmpd08:14:173
39629977,0cyclictest743-21snmpd07:30:323
39629977,0cyclictest741-21lldpd12:13:063
39629977,0cyclictest741-21lldpd11:31:383
39629977,0cyclictest741-21lldpd09:46:243
39629977,0cyclictest741-21lldpd09:25:393
39629976,1cyclictest26310-21taskset11:59:043
39629976,0cyclictest191rcu_preempt12:17:503
39629976,0cyclictest191rcu_preempt07:50:223
39629975,2cyclictest743-21snmpd09:52:003
39629975,2cyclictest743-21snmpd09:01:263
39629975,2cyclictest743-21snmpd08:05:483
39629973,2cyclictest0-21swapper/311:10:523
39629970,2cyclictest52-21ksoftirqd/308:50:143
39579977,0cyclictest743-21snmpd11:15:512
39579977,0cyclictest743-21snmpd10:14:012
39579977,0cyclictest741-21lldpd12:30:192
39579977,0cyclictest741-21lldpd12:21:092
39579977,0cyclictest741-21lldpd09:59:472
39579977,0cyclictest741-21lldpd09:39:592
39579977,0cyclictest741-21lldpd07:29:442
39579976,1cyclictest743-21snmpd07:57:592
39579976,1cyclictest741-21lldpd08:14:212
39579976,1cyclictest717-21ntpd12:11:182
39579976,1cyclictest717-21ntpd11:05:212
39579976,1cyclictest717-21ntpd10:51:172
39579976,1cyclictest26246-21needreboot09:20:162
39579975,2cyclictest743-21snmpd12:15:262
39579975,2cyclictest743-21snmpd10:49:082
39579975,2cyclictest743-21snmpd09:11:082
39579975,2cyclictest743-21snmpd09:06:262
39579975,2cyclictest743-21snmpd08:56:442
39579975,2cyclictest743-21snmpd08:35:312
39579975,2cyclictest743-21snmpd07:35:112
39579975,2cyclictest743-21snmpd07:20:382
39579975,2cyclictest717-21ntpd10:57:182
39579975,2cyclictest717-21ntpd10:34:102
39579975,2cyclictest717-21ntpd07:50:292
39579975,2cyclictest717-21ntpd07:10:302
39459977,0cyclictest743-21snmpd12:20:080
39459977,0cyclictest743-21snmpd11:21:540
39459977,0cyclictest743-21snmpd11:13:530
39459977,0cyclictest743-21snmpd10:31:100
39459977,0cyclictest743-21snmpd09:19:350
39459977,0cyclictest741-21lldpd12:18:030
39459977,0cyclictest741-21lldpd09:54:480
39459977,0cyclictest741-21lldpd09:32:490
39459976,1cyclictest743-21snmpd07:11:520
39459976,1cyclictest27282-21cat08:05:150
39459976,1cyclictest20698-21cpuspeed_turbos11:45:120
39459975,2cyclictest743-21snmpd10:51:050
39459975,2cyclictest743-21snmpd10:38:590
39459975,2cyclictest743-21snmpd08:36:340
39459975,2cyclictest743-21snmpd07:54:240
39629966,0cyclictest741-21lldpd11:04:383
39629966,0cyclictest5205-21taskset11:07:593
39629966,0cyclictest20729-21timerwakeupswit09:05:213
39629965,1cyclictest4366-21cut07:10:153
39629965,1cyclictest15773-21gltestperf08:55:143
39629965,0cyclictest191rcu_preempt09:30:143
39629965,0cyclictest191rcu_preempt09:15:163
39629964,2cyclictest743-21snmpd10:30:253
39629964,2cyclictest504-21haveged10:24:213
39629964,0cyclictest191rcu_preempt10:01:083
39629964,0cyclictest191rcu_preempt08:45:183
39629964,0cyclictest191rcu_preempt07:38:073
39629963,2cyclictest19289-21ps07:45:183
39629963,2cyclictest0-21swapper/310:40:003
39629962,3cyclictest16669-21grep07:40:133
39629962,2cyclictest52-21ksoftirqd/311:45:193
39629962,2cyclictest52-21ksoftirqd/311:40:153
39629962,2cyclictest52-21ksoftirqd/310:05:163
39629962,2cyclictest52-21ksoftirqd/308:25:163
39629962,1cyclictest191rcu_preempt07:59:473
39629961,2cyclictest52-21ksoftirqd/308:30:153
39629960,4cyclictest7491-21latency08:35:153
39629960,4cyclictest6159-21http07:15:113
39629960,4cyclictest52-21ksoftirqd/310:35:123
39579966,0cyclictest741-21lldpd10:35:592
39579965,1cyclictest743-21snmpd11:47:132
39579965,1cyclictest743-21snmpd07:34:142
39579965,1cyclictest717-21ntpd11:56:162
39579965,1cyclictest590-21gmain11:03:572
39579964,2cyclictest743-21snmpd11:53:252
39579964,2cyclictest717-21ntpd10:26:222
39579963,3cyclictest557-21NetworkManager08:20:132
39579963,2cyclictest26703-21ntpq10:40:162
39459966,0cyclictest743-21snmpd10:03:100
39459966,0cyclictest743-21snmpd09:38:320
39459966,0cyclictest743-21snmpd09:20:380
39459966,0cyclictest743-21snmpd07:56:510
39459966,0cyclictest743-21snmpd07:46:290
39459966,0cyclictest19800-21gltestperf10:25:140
39459966,0cyclictest17886-21gltestperf09:00:140
39459965,1cyclictest9084-21cpuspeed_turbos08:40:120
39459965,1cyclictest743-21snmpd10:19:430
39459965,1cyclictest741-21lldpd09:40:530
39459965,1cyclictest522-21avahi-daemon09:29:080
39459964,2cyclictest743-21snmpd07:36:530
39629954,1cyclictest511ktimers/309:20:173
39629954,0cyclictest191rcu_preempt10:10:153
39629953,1cyclictest191rcu_preempt11:50:163
39629952,3cyclictest30215-21perl10:50:123
39629952,2cyclictest0-21swapper/310:15:153
39629950,3cyclictest52-21ksoftirqd/311:25:123
39629950,3cyclictest52-21ksoftirqd/310:45:123
39629950,2cyclictest52-21ksoftirqd/309:35:163
39629950,2cyclictest52-21ksoftirqd/308:00:003
39629950,2cyclictest5137-21modprobe12:25:173
39579955,0cyclictest522-21avahi-daemon09:15:342
39579953,2cyclictest743-21snmpd09:52:092
39579953,2cyclictest557-21NetworkManager11:25:132
39579953,2cyclictest1698-21cat09:40:142
39579952,3cyclictest743-21snmpd08:54:022
39579952,3cyclictest28059-21irqstats09:25:152
39579952,2cyclictest244-20systemd-journal09:31:192
39579951,3cyclictest10263-21grep08:40:202
39459955,0cyclictest743-21snmpd10:48:140
39459954,1cyclictest26910-21fschecks_time12:00:120
39459953,2cyclictest25249-21cat08:00:140
39459952,3cyclictest557-21NetworkManager11:38:040
39459952,3cyclictest557-21NetworkManager11:16:390
39459952,2cyclictest32007-21ntp_kernel_err08:15:160
39579942,2cyclictest10137-21cat11:20:142
39579941,2cyclictest11520-21df10:05:122
39579940,3cyclictest17152-21/usr/sbin/munin07:40:162
39459942,2cyclictest8257-21grep07:20:120
39459942,2cyclictest743-21snmpd12:30:080
39459941,2cyclictest13935-21wc10:10:140
39459941,2cyclictest1120-21cut08:20:130
39459930,2cyclictest19660-21expr09:05:120
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional