You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-05 - 15:57

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #8, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack8slot6s.osadl.org (updated Sun Jul 05, 2026 12:43:42)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
30887992019,1cyclictest65850irq/126-lan10:34:550
30887991918,1cyclictest65850irq/126-lan12:30:130
30887991918,1cyclictest65850irq/126-lan08:55:160
30894991818,0cyclictest25833-21cat08:15:131
30887991818,0cyclictest65850irq/126-lan12:20:420
30887991818,0cyclictest65850irq/126-lan11:49:400
30887991818,0cyclictest65850irq/126-lan10:25:200
30887991817,1cyclictest65850irq/126-lan12:00:160
30887991817,1cyclictest65850irq/126-lan11:40:100
30887991817,1cyclictest65850irq/126-lan11:35:390
30887991817,1cyclictest65850irq/126-lan10:50:220
30887991817,1cyclictest65850irq/126-lan09:55:220
30887991817,1cyclictest65850irq/126-lan09:25:140
30894991717,0cyclictest743-21snmpd07:34:001
30887991717,0cyclictest65850irq/126-lan12:17:100
30887991717,0cyclictest65850irq/126-lan12:10:190
30887991717,0cyclictest65850irq/126-lan12:05:150
30887991717,0cyclictest65850irq/126-lan11:58:280
30887991717,0cyclictest65850irq/126-lan11:21:100
30887991716,1cyclictest65850irq/126-lan11:35:000
30887991716,1cyclictest65850irq/126-lan11:26:590
30887991616,0cyclictest65850irq/126-lan10:55:170
30887991616,0cyclictest65850irq/126-lan10:15:120
30887991616,0cyclictest65850irq/126-lan08:20:140
30887991616,0cyclictest65850irq/126-lan07:55:140
30887991615,1cyclictest65850irq/126-lan09:45:150
30887991615,1cyclictest65850irq/126-lan09:15:130
30887991615,1cyclictest65850irq/126-lan08:50:170
30887991615,1cyclictest65850irq/126-lan07:24:480
30887991515,0cyclictest65850irq/126-lan10:20:570
30887991515,0cyclictest65850irq/126-lan08:30:200
30887991515,0cyclictest65850irq/126-lan07:53:500
30887991514,1cyclictest65850irq/126-lan10:45:140
30887991514,1cyclictest65850irq/126-lan09:50:210
30887991514,1cyclictest65850irq/126-lan09:10:160
30887991514,1cyclictest65850irq/126-lan08:15:290
30887991514,1cyclictest65850irq/126-lan08:10:130
30887991414,0cyclictest65850irq/126-lan11:15:210
30887991414,0cyclictest65850irq/126-lan11:05:130
30887991414,0cyclictest65850irq/126-lan11:03:130
30887991414,0cyclictest65850irq/126-lan10:40:220
30887991414,0cyclictest65850irq/126-lan10:37:580
30887991414,0cyclictest65850irq/126-lan10:00:170
30887991414,0cyclictest65850irq/126-lan09:30:220
30887991414,0cyclictest65850irq/126-lan08:00:140
30887991413,1cyclictest65850irq/126-lan08:40:150
30887991413,1cyclictest65850irq/126-lan08:35:160
30887991413,1cyclictest65850irq/126-lan07:50:000
30887991413,1cyclictest65850irq/126-lan07:35:200
3090099131,3cyclictest31200-21cat08:29:552
30887991313,0cyclictest65850irq/126-lan09:35:130
30887991313,0cyclictest65850irq/126-lan09:20:100
30887991312,1cyclictest65850irq/126-lan08:45:120
30887991312,1cyclictest65850irq/126-lan08:05:170
30887991312,1cyclictest65850irq/126-lan07:30:170
30887991312,1cyclictest65850irq/126-lan07:15:130
30887991212,0cyclictest65850irq/126-lan12:35:160
3090099118,3cyclictest743-21snmpd09:31:452
3090099117,4cyclictest743-21snmpd07:45:302
3090099116,5cyclictest14844-21cat10:25:142
3090099113,5cyclictest557-21NetworkManager11:20:252
3090099107,3cyclictest743-21snmpd12:22:572
3090099107,3cyclictest743-21snmpd11:13:512
3090099107,3cyclictest743-21snmpd07:11:102
3090099107,3cyclictest741-21lldpd10:58:502
3090099107,3cyclictest741-21lldpd08:04:262
3090099106,4cyclictest743-21snmpd11:30:252
3090099106,4cyclictest743-21snmpd07:29:112
3088799109,1cyclictest65850irq/126-lan12:25:170
3088799109,1cyclictest65850irq/126-lan12:25:160
3088799109,1cyclictest65850irq/126-lan11:50:120
30887991010,0cyclictest65850irq/126-lan11:10:120
30887991010,0cyclictest65850irq/126-lan09:05:140
30887991010,0cyclictest65850irq/126-lan08:25:110
30887991010,0cyclictest65850irq/126-lan07:40:210
309049998,1cyclictest743-21snmpd10:59:573
309049998,1cyclictest743-21snmpd10:40:443
309049998,1cyclictest743-21snmpd08:49:053
309049998,1cyclictest522-21avahi-daemon08:12:223
309049996,1cyclictest191rcu_preempt09:19:503
309049991,5cyclictest7662-21memory11:25:153
309009997,2cyclictest741-21lldpd09:54:432
309009997,2cyclictest522-21avahi-daemon08:43:052
309009996,3cyclictest741-21lldpd08:55:342
309009995,4cyclictest743-21snmpd12:11:052
309009993,3cyclictest4884-21memory10:00:142
308949998,1cyclictest743-21snmpd12:27:031
308949998,1cyclictest743-21snmpd12:27:031
308879999,0cyclictest65850irq/126-lan09:00:200
308879998,1cyclictest65850irq/126-lan07:10:120
309049988,0cyclictest743-21snmpd11:42:283
309049988,0cyclictest743-21snmpd11:19:133
309049988,0cyclictest743-21snmpd07:58:143
309049988,0cyclictest741-21lldpd12:25:013
309049988,0cyclictest741-21lldpd12:25:013
309049988,0cyclictest741-21lldpd12:13:193
309049987,1cyclictest743-21snmpd09:04:283
309049986,2cyclictest743-21snmpd08:54:593
309049986,2cyclictest743-21snmpd08:39:113
309049986,2cyclictest743-21snmpd08:09:013
309049986,2cyclictest717-21ntpd08:00:163
309049986,0cyclictest191rcu_preempt11:21:023
309049984,2cyclictest0-21swapper/310:25:153
309049984,1cyclictest191rcu_preempt11:05:143
309049980,5cyclictest30324-21ntpq08:25:163
309049980,5cyclictest28174-21ntpq08:20:153
309049980,5cyclictest244-20systemd-journal11:45:443
309049980,5cyclictest13202-21ntpq10:20:173
309009988,0cyclictest743-21snmpd12:31:362
309009988,0cyclictest741-21lldpd08:22:462
309009987,1cyclictest743-21snmpd08:17:282
309009987,1cyclictest743-21snmpd08:11:282
309009986,2cyclictest743-21snmpd12:02:022
309009986,2cyclictest743-21snmpd11:58:052
309009986,2cyclictest741-21lldpd07:33:472
309009985,3cyclictest743-21snmpd10:33:142
309009983,2cyclictest20910-21cat10:40:162
309009983,1cyclictest25359-21ntpq10:50:192
309009983,1cyclictest0-21swapper/207:40:182
309009982,3cyclictest1900-21grep09:55:122
309009982,3cyclictest14867-21grep11:40:202
309009982,2cyclictest30675-21cat09:45:142
309009981,2cyclictest557-21NetworkManager09:12:522
309009980,4cyclictest20873-21ntpq09:20:142
309009980,3cyclictest875-21/usr/sbin/munin07:15:122
309009980,3cyclictest557-21NetworkManager12:07:082
309009980,3cyclictest32744-21dump-pmu-power11:10:002
308949988,0cyclictest743-21snmpd10:08:281
308949988,0cyclictest743-21snmpd08:29:461
308949988,0cyclictest741-21lldpd11:59:311
308949988,0cyclictest741-21lldpd11:47:571
308949987,1cyclictest743-21snmpd11:10:271
308949987,1cyclictest743-21snmpd10:56:511
308949987,1cyclictest741-21lldpd09:08:061
308949987,1cyclictest21233-21ntp_kernel_pll_10:40:181
308949986,2cyclictest743-21snmpd09:11:361
308949986,2cyclictest21812-21cat08:05:131
308949982,4cyclictest25622-21ls10:50:221
308949981,3cyclictest16889-21kworker/1:0-events08:05:001
308879987,1cyclictest65850irq/126-lan10:10:200
308879987,1cyclictest65850irq/126-lan09:40:110
309049977,0cyclictest743-21snmpd10:07:343
309049977,0cyclictest743-21snmpd10:04:103
309049977,0cyclictest741-21lldpd08:42:043
309049976,1cyclictest743-21snmpd09:48:223
309049976,1cyclictest743-21snmpd09:29:483
309049976,1cyclictest741-21lldpd10:39:233
309049976,1cyclictest717-21ntpd12:30:183
309049975,2cyclictest743-21snmpd10:31:023
309049975,2cyclictest717-21ntpd12:05:163
309049975,1cyclictest191rcu_preempt09:55:153
309049974,0cyclictest191rcu_preempt07:40:163
309049973,2cyclictest52-21ksoftirqd/312:35:123
309049973,2cyclictest52-21ksoftirqd/312:15:163
309049973,2cyclictest52-21ksoftirqd/311:30:163
309049973,2cyclictest52-21ksoftirqd/310:15:123
309049973,2cyclictest52-21ksoftirqd/309:05:173
309049973,2cyclictest0-21swapper/311:35:013
309049973,0cyclictest191rcu_preempt08:55:183
309049972,1cyclictest0-21swapper/310:50:123
309049971,2cyclictest0-21swapper/309:10:213
309009977,0cyclictest743-21snmpd10:45:152
309009977,0cyclictest743-21snmpd08:06:222
309009977,0cyclictest741-21lldpd07:50:172
309009976,1cyclictest522-21avahi-daemon10:20:042
309009975,2cyclictest743-21snmpd11:35:402
309009973,1cyclictest12909-21ntpq09:00:192
309009972,2cyclictest9238-21irqstats07:35:162
309009972,2cyclictest557-21NetworkManager08:48:002
309009972,2cyclictest22727-21cat09:25:152
309009972,1cyclictest28290-21cpuspeed_turbos09:40:112
309009971,3cyclictest557-21NetworkManager11:26:292
309009971,2cyclictest2900-21df07:20:132
309009970,4cyclictest32660-21ntpq08:30:172
309009970,3cyclictest8518-21diskstats10:10:122
309009970,3cyclictest8171-21df08:50:122
309009970,3cyclictest7194-21ntp_states10:05:172
309009970,3cyclictest28417-21/usr/sbin/munin12:15:122
309009970,3cyclictest18938-21ntp_states09:15:172
309009970,3cyclictest18739-21fw_conntrack10:35:142
309009970,3cyclictest18162-21ntpq07:55:152
309009970,3cyclictest17042-21taskset11:46:162
309009970,3cyclictest15816-21latency_hist09:10:002
309009970,3cyclictest1149-21users12:25:222
309009970,3cyclictest1149-21users12:25:222
309009970,3cyclictest10533-21diskstats10:15:112
308949977,0cyclictest743-21snmpd11:43:281
308949977,0cyclictest743-21snmpd07:46:121
308949977,0cyclictest741-21lldpd12:16:331
308949977,0cyclictest741-21lldpd11:30:241
308949977,0cyclictest741-21lldpd11:15:441
308949977,0cyclictest741-21lldpd09:49:331
308949977,0cyclictest741-21lldpd08:36:521
308949977,0cyclictest741-21lldpd07:52:531
308949976,1cyclictest743-21snmpd09:42:211
308949976,1cyclictest743-21snmpd09:25:031
308949976,1cyclictest743-21snmpd08:40:351
308949976,1cyclictest743-21snmpd07:57:151
308949976,1cyclictest743-21snmpd07:36:511
308949976,1cyclictest741-21lldpd11:52:251
308949976,1cyclictest573-21in:imuxsock10:25:591
308949976,1cyclictest32528-21needreboot08:30:141
308949975,2cyclictest743-21snmpd09:04:411
308949975,2cyclictest743-21snmpd07:20:471
308879977,0cyclictest65850irq/126-lan10:08:570
308879977,0cyclictest65850irq/126-lan07:25:170
309049965,1cyclictest743-21snmpd10:10:163
309049965,1cyclictest741-21lldpd09:54:053
309049965,1cyclictest292-21systemd-udevd09:22:503
309049965,0cyclictest191rcu_preempt07:22:063
309049964,2cyclictest599-21thermald07:29:453
309049964,2cyclictest30881-21cyclictest07:35:023
309049964,1cyclictest191rcu_preempt11:10:163
309049963,2cyclictest18332-21ntpq11:50:153
309049963,1cyclictest52-21ksoftirqd/309:35:163
309049962,2cyclictest52-21ksoftirqd/309:40:123
309049961,3cyclictest52-21ksoftirqd/311:55:003
309049961,3cyclictest29677-21ntp_192.168.11411:00:183
309049961,2cyclictest52-21ksoftirqd/312:20:193
309049960,4cyclictest52-21ksoftirqd/307:50:163
309049960,3cyclictest31785-21ntp_192.168.11407:10:163
309049960,3cyclictest22877-21ntpq12:00:163
309049960,3cyclictest13651-21ntpq07:45:163
309049960,2cyclictest32094-21fschecks_count08:30:133
309009962,1cyclictest575-21rs:main2
309009962,1cyclictest5529-21sshd12:39:422
309009960,3cyclictest29823-21ntpq11:00:192
309009960,3cyclictest26566-21hddtemp_smartct09:35:132
309009960,3cyclictest1507-21/usr/sbin/munin08:35:182
308949966,0cyclictest743-21snmpd12:30:541
308949966,0cyclictest743-21snmpd11:03:451
308949966,0cyclictest743-21snmpd07:44:121
308949966,0cyclictest741-21lldpd11:21:121
308949966,0cyclictest741-21lldpd08:59:001
308949965,1cyclictest743-21snmpd08:11:311
308949965,1cyclictest522-21avahi-daemon10:14:241
308949964,2cyclictest743-21snmpd08:45:591
308949963,2cyclictest758-21pmu-power09:50:171
308949963,1cyclictest191rcu_preempt12:10:001
308949962,2cyclictest34-21ksoftirqd/110:30:111
308949961,3cyclictest27224-21timerandwakeup12:10:221
308949960,1cyclictest0-21swapper/110:15:161
309049953,2cyclictest743-21snmpd07:15:023
309049953,0cyclictest191rcu_preempt07:30:163
309049952,2cyclictest0-21swapper/310:45:133
309049950,3cyclictest52-21ksoftirqd/309:30:133
309049950,1cyclictest26147-21ntpq08:15:153
309009950,3cyclictest2795-21diskstats11:15:122
308949955,0cyclictest743-21snmpd12:39:001
308949955,0cyclictest741-21lldpd09:57:011
308949955,0cyclictest20437-21gltestperf09:20:121
308949954,1cyclictest743-21snmpd08:22:581
308949954,1cyclictest743-21snmpd07:15:351
308949954,1cyclictest0-21swapper/112:00:121
308949954,0cyclictest191rcu_preempt09:35:211
308949953,2cyclictest557-21NetworkManager12:20:181
308949953,0cyclictest191rcu_preempt10:35:131
308949952,2cyclictest7831-21sed11:25:161
308949952,2cyclictest5765-21seq10:01:171
308949952,2cyclictest32139-21sed07:10:191
308949952,2cyclictest12802-21sort10:20:141
308949952,2cyclictest11275-21dpkg11:35:001
308949952,0cyclictest191rcu_preempt10:45:161
308949951,4cyclictest9786-21cat08:55:001
308949951,3cyclictest5353-21sed07:25:141
308949943,1cyclictest31379-21gltestperf11:05:141
308949941,2cyclictest24464-21fw_packets09:30:141
308949940,0cyclictest0-21swapper/109:15:151
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional