You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-20 - 07:16

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #8, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack8slot6s.osadl.org (updated Fri Mar 20, 2026 00:43:44)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1316991917,2cyclictest65850irq/126-lan21:40:131
1316991917,2cyclictest65850irq/126-lan21:06:551
1316991818,0cyclictest65850irq/126-lan21:11:141
1316991817,1cyclictest65850irq/126-lan23:45:111
1316991817,1cyclictest65850irq/126-lan22:10:121
1316991817,1cyclictest65850irq/126-lan21:20:191
1316991817,1cyclictest65850irq/126-lan19:30:121
1316991816,2cyclictest65850irq/126-lan20:30:151
1316991717,0cyclictest65850irq/126-lan19:25:201
1316991716,1cyclictest65850irq/126-lan23:15:011
1316991716,1cyclictest65850irq/126-lan23:10:191
1316991716,1cyclictest65850irq/126-lan22:55:451
1316991716,1cyclictest65850irq/126-lan22:40:581
1316991716,1cyclictest65850irq/126-lan21:45:111
1316991716,1cyclictest65850irq/126-lan21:15:101
1316991716,1cyclictest65850irq/126-lan19:45:111
1316991716,1cyclictest65850irq/126-lan00:20:141
1316991715,2cyclictest65850irq/126-lan22:50:141
1316991616,0cyclictest65850irq/126-lan20:05:451
1316991615,1cyclictest65850irq/126-lan23:20:141
1316991615,1cyclictest65850irq/126-lan22:25:151
1316991615,1cyclictest65850irq/126-lan21:55:171
1316991615,1cyclictest65850irq/126-lan20:40:181
1316991615,1cyclictest65850irq/126-lan20:00:151
1316991615,1cyclictest65850irq/126-lan19:13:461
1316991614,2cyclictest65850irq/126-lan20:20:121
1316991515,0cyclictest65850irq/126-lan23:25:151
1316991515,0cyclictest65850irq/126-lan22:15:201
1316991515,0cyclictest65850irq/126-lan20:46:361
1316991514,1cyclictest65850irq/126-lan20:35:161
1316991514,1cyclictest65850irq/126-lan19:40:151
1316991513,2cyclictest65850irq/126-lan23:50:151
1316991513,2cyclictest65850irq/126-lan21:25:141
1316991513,2cyclictest65850irq/126-lan00:00:201
1316991414,0cyclictest65850irq/126-lan23:55:181
1316991414,0cyclictest65850irq/126-lan22:35:151
1316991414,0cyclictest65850irq/126-lan20:50:141
1316991414,0cyclictest65850irq/126-lan19:35:591
1316991414,0cyclictest65850irq/126-lan00:30:141
1316991413,1cyclictest65850irq/126-lan23:30:171
1316991413,1cyclictest65850irq/126-lan20:10:181
1316991412,2cyclictest65850irq/126-lan22:45:161
1316991313,0cyclictest65850irq/126-lan23:00:121
1316991313,0cyclictest65850irq/126-lan22:32:471
1316991313,0cyclictest65850irq/126-lan00:35:461
1316991312,1cyclictest65850irq/126-lan23:05:141
1316991312,1cyclictest65850irq/126-lan22:20:131
1316991312,1cyclictest65850irq/126-lan22:05:191
1316991312,1cyclictest65850irq/126-lan21:52:331
1316991312,1cyclictest65850irq/126-lan00:25:151
1316991311,2cyclictest65850irq/126-lan22:00:181
1316991311,2cyclictest65850irq/126-lan19:50:191
1316991212,0cyclictest65850irq/126-lan20:15:171
1316991212,0cyclictest65850irq/126-lan19:59:591
1316991212,0cyclictest65850irq/126-lan00:10:161
1316991211,1cyclictest65850irq/126-lan19:20:161
1316991210,2cyclictest65850irq/126-lan19:19:461
1316991111,0cyclictest65850irq/126-lan20:55:451
1316991110,1cyclictest65850irq/126-lan20:25:161
1316991110,1cyclictest65850irq/126-lan00:05:161
131699109,1cyclictest65850irq/126-lan00:20:001
131699108,2cyclictest743-21snmpd23:43:281
131699108,2cyclictest743-21snmpd23:43:281
130899109,1cyclictest506-21systemd-resolve20:05:200
13259998,1cyclictest743-21snmpd23:57:053
13259998,1cyclictest743-21snmpd21:18:473
13259998,1cyclictest743-21snmpd19:17:073
13259998,1cyclictest741-21lldpd23:01:213
13259998,1cyclictest741-21lldpd21:25:593
13259998,1cyclictest741-21lldpd21:03:573
13219998,1cyclictest743-21snmpd22:28:552
13219998,1cyclictest743-21snmpd20:43:042
13219998,1cyclictest743-21snmpd00:04:012
13169998,1cyclictest65850irq/126-lan23:35:161
13169998,1cyclictest65850irq/126-lan23:35:151
13169998,1cyclictest65850irq/126-lan21:00:161
13089998,1cyclictest743-21snmpd23:39:490
13089998,1cyclictest743-21snmpd23:39:490
13089998,1cyclictest743-21snmpd22:31:230
13089998,1cyclictest743-21snmpd20:41:210
13089998,1cyclictest741-21lldpd22:37:000
13259988,0cyclictest743-21snmpd22:24:033
13259988,0cyclictest741-21lldpd23:10:463
13259988,0cyclictest741-21lldpd22:27:543
13259988,0cyclictest741-21lldpd22:11:203
13259987,1cyclictest743-21snmpd23:53:343
13259987,1cyclictest743-21snmpd00:32:413
13259987,1cyclictest741-21lldpd20:05:313
13259987,1cyclictest741-21lldpd00:00:483
13259986,2cyclictest743-21snmpd22:34:233
13259986,2cyclictest743-21snmpd00:35:333
13219988,0cyclictest741-21lldpd22:24:322
13219988,0cyclictest741-21lldpd22:11:532
13219988,0cyclictest741-21lldpd00:06:172
13219987,1cyclictest743-21snmpd20:30:182
13219987,1cyclictest741-21lldpd22:41:072
13219986,2cyclictest743-21snmpd23:21:092
13219986,2cyclictest743-21snmpd23:13:262
13219986,2cyclictest743-21snmpd22:47:112
13219986,2cyclictest743-21snmpd21:09:402
13219986,2cyclictest743-21snmpd19:31:192
13169987,1cyclictest743-21snmpd21:38:001
13089988,0cyclictest743-21snmpd20:11:320
13089988,0cyclictest741-21lldpd00:29:220
13089988,0cyclictest741-21lldpd00:04:210
13089986,2cyclictest743-21snmpd21:40:230
13089986,2cyclictest743-21snmpd20:33:210
13089986,2cyclictest743-21snmpd19:38:160
13089986,2cyclictest4269-21cat20:35:120
13259977,0cyclictest743-21snmpd22:58:473
13259977,0cyclictest741-21lldpd23:28:443
13259977,0cyclictest741-21lldpd23:21:553
13259977,0cyclictest741-21lldpd19:46:563
13259976,1cyclictest743-21snmpd22:42:013
13259976,1cyclictest743-21snmpd19:58:083
13259976,1cyclictest741-21lldpd20:52:403
13259976,1cyclictest741-21lldpd20:39:283
13259976,1cyclictest573-21in:imuxsock21:37:453
13259976,1cyclictest522-21avahi-daemon20:40:263
13259975,2cyclictest743-21snmpd22:00:553
13259975,2cyclictest743-21snmpd19:42:173
13259975,2cyclictest22448-21cat21:20:143
13219977,0cyclictest743-21snmpd00:23:002
13219977,0cyclictest741-21lldpd23:09:392
13219977,0cyclictest741-21lldpd20:46:052
13219976,1cyclictest741-21lldpd23:29:522
13219975,2cyclictest743-21snmpd21:25:312
13219975,2cyclictest743-21snmpd20:36:032
13219975,2cyclictest743-21snmpd20:14:362
13219975,2cyclictest743-21snmpd19:10:072
13169971,3cyclictest26330-21perl21:30:141
13089977,0cyclictest743-21snmpd22:50:470
13089977,0cyclictest743-21snmpd22:00:280
13089977,0cyclictest743-21snmpd21:15:200
13089977,0cyclictest741-21lldpd23:43:510
13089977,0cyclictest741-21lldpd23:43:510
13089977,0cyclictest741-21lldpd22:46:400
13089977,0cyclictest741-21lldpd19:32:560
13089977,0cyclictest741-21lldpd19:17:070
13089977,0cyclictest741-21lldpd00:06:530
13089977,0cyclictest244-20systemd-journal20:48:480
13089976,1cyclictest743-21snmpd21:50:540
13089976,1cyclictest743-21snmpd21:36:210
13089976,1cyclictest743-21snmpd21:25:040
13089976,1cyclictest743-21snmpd20:55:060
13089976,1cyclictest743-21snmpd19:53:440
13089975,2cyclictest743-21snmpd22:57:110
13089975,2cyclictest743-21snmpd21:46:120
13089975,2cyclictest743-21snmpd21:34:420
13089975,2cyclictest743-21snmpd19:49:590
13089975,2cyclictest743-21snmpd00:34:120
13259966,0cyclictest743-21snmpd22:36:113
13259966,0cyclictest743-21snmpd19:13:253
13259966,0cyclictest741-21lldpd23:37:313
13259966,0cyclictest741-21lldpd23:37:303
13259966,0cyclictest741-21lldpd23:15:433
13259966,0cyclictest741-21lldpd21:46:573
13259966,0cyclictest741-21lldpd20:47:433
13259966,0cyclictest741-21lldpd20:14:003
13259965,1cyclictest743-21snmpd22:51:263
13259965,1cyclictest743-21snmpd19:26:583
13259965,1cyclictest743-21snmpd00:28:393
13259965,1cyclictest741-21lldpd23:34:573
13259965,1cyclictest741-21lldpd21:54:073
13259965,1cyclictest522-21avahi-daemon19:31:473
13259965,1cyclictest522-21avahi-daemon00:21:553
13259965,1cyclictest23435-21cron20:05:003
13259964,2cyclictest743-21snmpd22:45:593
13259964,2cyclictest743-21snmpd21:56:003
13259964,2cyclictest743-21snmpd00:18:013
13259964,2cyclictest743-21snmpd00:12:563
13219966,0cyclictest743-21snmpd23:19:512
13219966,0cyclictest743-21snmpd19:57:172
13219966,0cyclictest743-21snmpd19:35:182
13219966,0cyclictest741-21lldpd21:55:212
13219966,0cyclictest741-21lldpd00:31:332
13219966,0cyclictest522-21avahi-daemon20:27:532
13219965,1cyclictest743-21snmpd20:51:302
13219965,1cyclictest743-21snmpd00:17:312
13219965,1cyclictest741-21lldpd22:55:492
13219965,1cyclictest741-21lldpd20:55:512
13219965,1cyclictest5913-21needreboot00:35:152
13219965,1cyclictest522-21avahi-daemon20:03:492
13219964,2cyclictest743-21snmpd21:22:192
13219964,2cyclictest743-21snmpd21:12:352
13219964,2cyclictest743-21snmpd00:26:122
13219960,5cyclictest7469-21cat19:24:592
13089966,0cyclictest743-21snmpd23:50:040
13089966,0cyclictest743-21snmpd21:57:230
13089966,0cyclictest741-21lldpd23:25:060
13089966,0cyclictest741-21lldpd22:42:530
13089966,0cyclictest522-21avahi-daemon20:51:110
13089965,1cyclictest743-21snmpd22:10:420
13089965,1cyclictest743-21snmpd19:12:030
13089965,1cyclictest1301-21cyclictest23:20:010
13089964,2cyclictest743-21snmpd23:49:430
13089964,2cyclictest743-21snmpd21:24:320
13089964,2cyclictest743-21snmpd00:12:470
13089962,3cyclictest17307-21users21:05:210
13259955,0cyclictest741-21lldpd23:47:323
13259955,0cyclictest741-21lldpd23:41:353
13259955,0cyclictest741-21lldpd23:41:353
13259955,0cyclictest741-21lldpd22:17:443
13259955,0cyclictest741-21lldpd22:05:073
13259954,1cyclictest532-21irqbalance19:50:223
13259953,2cyclictest743-21snmpd21:11:413
13259953,2cyclictest244-20systemd-journal20:17:273
13259952,3cyclictest743-21snmpd20:22:533
13259952,3cyclictest30431-21grep21:40:133
13259952,3cyclictest27048-21find21:30:193
13259952,3cyclictest25774-21sed00:05:143
13259952,3cyclictest11759-21diskstats19:35:103
13259952,2cyclictest244-20systemd-journal23:09:223
13259951,3cyclictest16986-21mailstats21:05:193
13259951,3cyclictest12309-21ls20:55:143
13219955,0cyclictest743-21snmpd21:38:382
13219955,0cyclictest741-21lldpd22:53:582
13219955,0cyclictest741-21lldpd22:33:522
13219955,0cyclictest522-21avahi-daemon21:47:392
13219955,0cyclictest522-21avahi-daemon20:21:002
13219955,0cyclictest522-21avahi-daemon20:15:572
13219954,1cyclictest743-21snmpd23:55:072
13219953,2cyclictest743-21snmpd20:06:042
13219953,2cyclictest717-21ntpd23:00:152
13219952,3cyclictest557-21NetworkManager22:17:152
13219952,2cyclictest575-21rs:main2
13219952,2cyclictest244-20systemd-journal23:34:562
13219951,3cyclictest20568-21sed23:55:012
13219951,3cyclictest15439-21ntpq23:40:162
13219951,3cyclictest15439-21ntpq23:40:162
13219950,4cyclictest4274-21ntpq19:15:162
13219950,4cyclictest27952-21ntpq00:10:162
13219950,4cyclictest21322-21sed21:15:202
13089955,0cyclictest743-21snmpd23:10:140
13089955,0cyclictest743-21snmpd00:39:020
13089955,0cyclictest30969-21sendmail00:20:010
13089954,1cyclictest22082-21hddtemp_smartct20:00:150
13089953,2cyclictest743-21snmpd22:21:190
13089953,2cyclictest575-21rs:main0
13089952,3cyclictest557-21NetworkManager19:27:050
13089952,2cyclictest872-21ld23:05:160
13089952,2cyclictest31069-21grep23:00:150
13089952,2cyclictest244-20systemd-journal21:04:160
13089952,2cyclictest244-20systemd-journal19:40:180
13089952,2cyclictest20949-21awk19:55:190
13089952,2cyclictest12782-21load22:15:140
13089951,3cyclictest32528-21awk00:20:160
13089951,3cyclictest12513-21cat23:35:010
13089950,4cyclictest6319-21ntpq19:20:140
13259941,2cyclictest1853-21cpu20:30:133
13259940,4cyclictest5770-21cut19:20:113
13259940,3cyclictest32367-21diskstats20:25:133
13219944,0cyclictest7905-21gltestperf19:25:132
13219944,0cyclictest0-21swapper/223:45:132
13219943,1cyclictest0-21swapper/219:50:152
13219942,2cyclictest743-21snmpd21:40:082
13219942,2cyclictest557-21NetworkManager22:36:192
13219942,2cyclictest14369-21cat21:00:122
13219942,2cyclictest13242-21grep23:35:152
13219942,2cyclictest13242-21grep23:35:142
13219941,3cyclictest557-21NetworkManager21:52:032
13219941,2cyclictest26340-21gltestperf21:30:142
13219941,2cyclictest13627-21dpkg19:40:102
13219940,3cyclictest6058-21perl22:00:132
13219940,3cyclictest15803-21diskstats19:45:122
13089944,0cyclictest522-21avahi-daemon22:05:090
13089942,2cyclictest743-21snmpd21:10:010
13089942,2cyclictest16333-21awk22:25:120
13089941,2cyclictest6860-21grep23:20:120
13089941,2cyclictest528-21sed20:25:170
13089941,2cyclictest30402-21cut20:20:110
13089941,2cyclictest21710-21switchtime23:55:220
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional