You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-11 - 23:35

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #2, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack2slot7s.osadl.org (updated Thu Jun 11, 2026 12:43:32)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1209907996357,3cyclictest0-21swapper/107:50:031
1209906996244,15cyclictest1276933-40mandb09:58:060
1209908995950,5cyclictest1276949-21ssh09:58:052
1209906995951,4cyclictest0-21swapper/011:40:280
1209908995436,10cyclictest0-21swapper/210:35:282
1209908995436,10cyclictest0-21swapper/210:35:282
1209907995347,3cyclictest0-21swapper/110:05:211
1209906995328,17cyclictest12650irq/32-eth010:35:240
1209906995328,17cyclictest12650irq/32-eth010:35:240
1209907995233,4cyclictest171rcu_preempt10:20:221
120990799523,11cyclictest171rcu_preempt09:25:231
1209906995143,6cyclictest151ktimers/009:40:210
120990899494,37cyclictest1347909-21ssh11:50:272
1209908994939,7cyclictest0-21swapper/211:20:232
1209907994937,8cyclictest1312317-21latency_hist10:55:031
1209907994937,8cyclictest1312317-21latency_hist10:55:031
1209906994930,11cyclictest12650irq/32-eth012:00:350
1209908994837,6cyclictest0-21swapper/207:50:022
1209906994840,4cyclictest0-21swapper/012:30:010
1209907994638,5cyclictest421-21dbus-daemon08:35:011
1209906994633,11cyclictest1291839-21head10:20:350
120990699461,42cyclictest1222073-21latency_hist07:50:030
1209908994536,6cyclictest1287048-21cron10:15:012
1209907994536,6cyclictest1230940-21idleruntime-cro08:20:011
1209906994540,3cyclictest1353127-21basename12:00:010
1209906994534,8cyclictest151ktimers/008:10:260
1209906994530,12cyclictest1280780-21munin-plugin-st10:05:010
1209906994528,11cyclictest12650irq/32-eth011:10:290
120990799446,3cyclictest171rcu_preempt11:15:261
120990899434,36cyclictest1363498-21ssh12:15:252
1209907994333,6cyclictest421-21dbus-daemon12:10:021
120990799432,33cyclictest1313309-21ssh10:55:261
1209908994234,5cyclictest1238463-21sh08:45:012
1209908994233,4cyclictest0-21swapper/209:50:242
1209908994232,6cyclictest1209905-21cyclictest12:05:242
120990799424,24cyclictest1288072-21ssh10:15:241
1209907994235,3cyclictest0-21swapper/110:10:231
1209906994234,5cyclictest1367278-21unixbench_multi12:20:390
1209908994133,5cyclictest1353086-21ssh12:00:012
1209908994133,5cyclictest1343760-21latency_hist11:45:022
1209908994132,6cyclictest421-21dbus-daemon10:30:022
120990799416,8cyclictest171rcu_preempt11:30:261
1209907994135,3cyclictest0-21swapper/109:40:011
1209907994134,4cyclictest1244450-21munin-plugin-st09:05:011
1209907994131,6cyclictest1212897-21idleruntime-cro07:20:011
1209907994129,8cyclictest0-21swapper/110:35:231
1209907994129,8cyclictest0-21swapper/110:35:231
1209906994128,11cyclictest1365658-21ssh12:20:010
1209907994029,6cyclictest423725-21cups-browsed12:02:101
1209906994035,3cyclictest1003-21mta-sts-daemon11:50:280
120990699403,29cyclictest1319612-21ssh11:05:270
1209908993931,5cyclictest1303424-21fschecks_time10:40:192
1209908993931,5cyclictest1303424-21fschecks_time10:40:192
1209908993931,5cyclictest1250678-21sed09:15:352
1209908993930,5cyclictest1246055-21latency_hist09:10:022
1209908993928,8cyclictest1234745-21needreboot08:30:222
120990799394,29cyclictest1253371-21ssh09:20:251
120990799394,24cyclictest1316473-21ssh11:00:281
120990799392,27cyclictest1332186-21ssh11:25:261
120990699392,28cyclictest1256490-21ssh09:25:240
120990799384,18cyclictest1269266-21ssh09:45:271
120990799383,29cyclictest1338444-21ssh11:35:261
1209907993831,4cyclictest1223942-21fschecks_count07:55:171
120990799382,11cyclictest171rcu_preempt12:30:251
1209906993826,8cyclictest1356560-21acpi12:05:130
1209906993823,12cyclictest0-21swapper/009:15:170
1209906993819,12cyclictest12650irq/32-eth010:40:280
1209906993819,12cyclictest12650irq/32-eth010:40:280
120990899373,29cyclictest1281789-21ssh10:05:232
1209908993729,5cyclictest1244416-21kworker/u8:4+xprtiod09:05:012
1209908993729,5cyclictest0-21swapper/210:20:012
1209908993727,6cyclictest1-21systemd07:35:012
1209908993726,8cyclictest1220077-21switchtime07:40:342
120990899372,27cyclictest1335346-21sh11:30:272
1209908993713,6cyclictest62750lldpd11:48:042
120990799379,7cyclictest171rcu_preempt09:15:241
120990799373,28cyclictest1245940-21diskmemload12:15:271
1209907993731,3cyclictest1244416-21kworker/u8:4-nfsiod09:30:221
1209907993729,5cyclictest1277605-21latency_hist10:00:011
1209907993729,5cyclictest1223423-21cron07:55:001
1209907993727,7cyclictest1299650-21/usr/sbin/munin10:35:021
1209907993724,9cyclictest1-21systemd11:55:011
120990699372,31cyclictest1316459-21sh11:00:270
1209906993722,9cyclictest12650irq/32-eth011:35:230
120990699371,6cyclictest151ktimers/008:50:270
1209908993628,5cyclictest421-21dbus-daemon12:35:272
120990899362,26cyclictest1354159-21ssh12:00:312
1209907993628,5cyclictest1242928-21grep09:00:011
1209907993628,4cyclictest0-21swapper/111:45:201
120990699363,28cyclictest1288177-21ssh10:15:290
1209906993630,4cyclictest1315528-21latency_hist11:00:020
1209906993628,5cyclictest1259391-21kernelversion09:30:170
1209906993613,13cyclictest12650irq/32-eth012:30:230
120990699360,31cyclictest1281726-21ssh10:05:220
1209908993527,5cyclictest1291398-21proc_pri10:20:302
1209908993526,7cyclictest1256354-21missed_timers09:25:202
120990899352,25cyclictest1269159-21ssh09:45:232
1209907993529,3cyclictest0-21swapper/107:35:001
1209907993527,5cyclictest1304210-21timerandwakeup10:40:361
1209907993527,5cyclictest1304210-21timerandwakeup10:40:361
1209907993525,6cyclictest0-21swapper/109:50:311
120990699353,26cyclictest567-21gdbus09:05:320
1209906993526,7cyclictest1212767-21tail07:15:380
1209906993523,9cyclictest1-21systemd08:30:010
1209906993523,10cyclictest0-21swapper/009:45:320
1209906993516,3cyclictest171rcu_preempt08:30:270
1209906993514,5cyclictest0-21swapper/012:35:230
1209906993512,9cyclictest12650irq/32-eth012:10:290
1209906993512,14cyclictest12650irq/32-eth011:25:280
120990699351,15cyclictest14-21ksoftirqd/007:35:250
1209908993428,2cyclictest0-21swapper/207:55:012
1209908993427,4cyclictest1315381-21cron11:00:002
1209908993427,3cyclictest0-21swapper/209:35:202
1209908993422,9cyclictest1211388-21munin-plugin-st07:15:012
120990899341,27cyclictest1259669-21sshd09:30:222
1209907993426,4cyclictest1245957-21sh09:10:011
1209907993424,7cyclictest421-21dbus-daemon07:10:011
1209906993426,6cyclictest1336013-21sshd11:30:530
1209906993423,5cyclictest423725-21cups-browsed08:40:230
1209906993422,7cyclictest1344804-21sh11:45:290
1209906993419,8cyclictest12650irq/32-eth009:20:280
120990899338,15cyclictest1000-21mta-sts-daemon11:35:242
120990899333,26cyclictest1319723-21ssh11:05:312
120990799337,7cyclictest171rcu_preempt11:10:281
120990799334,23cyclictest1369955-21ssh12:25:301
120990799333,23cyclictest1319621-21ssh11:05:271
1209907993326,4cyclictest1213453-21tr07:20:171
1209907993326,4cyclictest1213453-21tr07:20:171
1209907993324,5cyclictest1368914-21latency_hist12:25:021
1209907993324,4cyclictest0-21swapper/110:45:141
1209906993329,3cyclictest1209905-21cyclictest08:35:260
1209906993316,9cyclictest12650irq/32-eth010:25:220
1209906993313,3cyclictest171rcu_preempt09:10:230
120990699331,20cyclictest1329046-21ssh11:20:250
1209908993224,5cyclictest1370311-21timerwakeupswit12:25:362
1209908993224,5cyclictest1255482-21ssh09:25:012
1209908993223,7cyclictest1318580-21sh11:05:012
1209908993223,6cyclictest0-21swapper/211:10:222
1209908993219,8cyclictest0-21swapper/209:40:242
1209907993226,3cyclictest0-21swapper/107:40:011
1209907993225,4cyclictest1342199-21unixbench_singl11:40:401
1209907993225,4cyclictest1278864-21mailstats10:00:331
120990799321,27cyclictest1246977-21ssh09:10:251
120990699323,23cyclictest12650irq/32-eth011:15:260
1209906993225,5cyclictest151ktimers/007:10:250
1209906993224,5cyclictest191rcuc/007:10:010
1209906993220,9cyclictest12650irq/32-eth010:10:250
1209906993220,6cyclictest171rcu_preempt07:20:220
1209906993220,6cyclictest171rcu_preempt07:20:220
1209906993219,3cyclictest171rcu_preempt09:50:270
1209906993218,9cyclictest423725-21cups-browsed09:00:010
120990699321,17cyclictest1306930-21ld10:45:230
1209908993124,4cyclictest1228457-21fschecks_time08:10:172
1209908993124,3cyclictest0-21swapper/212:15:012
1209908993124,3cyclictest0-21swapper/211:25:132
1209908993124,3cyclictest0-21swapper/211:15:302
1209908993122,6cyclictest567-21gdbus08:00:322
1209907993122,7cyclictest1002-21mta-sts-daemon12:13:491
1209907993120,6cyclictest1350432-21cpu11:55:141
1209907993118,8cyclictest1294370-21sh10:25:241
120990799311,25cyclictest1376098-21ssh12:35:241
120990699319,6cyclictest14-21ksoftirqd/009:00:290
120990899303,21cyclictest1366731-21ssh12:20:272
1209908993024,3cyclictest0-21swapper/209:00:012
120990899302,23cyclictest1306898-21ssh10:45:222
1209908993021,6cyclictest420-21avahi-daemon07:10:012
1209908993021,6cyclictest1238842-21aten_r2power_vo08:45:132
1209908993021,5cyclictest1212886-21cron07:20:002
1209908993019,8cyclictest1246658-21sh09:10:192
120990699306,8cyclictest14-21ksoftirqd/008:05:220
120990699305,9cyclictest14-21ksoftirqd/008:45:240
120990699302,22cyclictest1310117-21ssh10:50:250
120990699302,22cyclictest1310117-21ssh10:50:250
1209906993018,3cyclictest171rcu_preempt07:30:240
1209906993010,13cyclictest171rcu_preempt08:20:120
1209908992923,3cyclictest0-21swapper/208:40:012
1209908992920,6cyclictest1310657-21unixbench_multi10:50:362
1209908992920,6cyclictest1310657-21unixbench_multi10:50:362
1209908992919,6cyclictest1278491-21missed_timers10:00:212
120990899291,21cyclictest1373070-21ssh12:30:292
1209907992924,2cyclictest0-21swapper/111:25:011
1209907992923,3cyclictest0-21swapper/109:45:011
120990699295,9cyclictest14-21ksoftirqd/008:00:250
120990699293,9cyclictest14-21ksoftirqd/010:34:430
120990699293,18cyclictest14-21ksoftirqd/007:55:160
1209908992822,3cyclictest0-21swapper/210:30:192
1209908992820,4cyclictest1218886-21grep07:40:012
1209908992819,6cyclictest421-21dbus-daemon08:10:012
120990799286,14cyclictest1231801-21sshd08:20:221
120990699284,8cyclictest14-21ksoftirqd/008:15:220
1209906992820,3cyclictest1262838-21awk09:35:250
1209906992816,3cyclictest171rcu_preempt07:50:230
1209908992719,5cyclictest1000-21mta-sts-daemon08:15:032
1209908992718,5cyclictest1233121-21latency08:25:222
120990799275,7cyclictest171rcu_preempt07:40:251
120990799273,16cyclictest1240777-21sshd08:50:221
120990799272,19cyclictest423721-21cupsd08:10:271
1209907992720,4cyclictest1236933-21munin-plugin-st08:40:011
1209907992716,8cyclictest1239868-21unixbench_singl08:45:351
120990799271,5cyclictest171rcu_preempt07:10:231
1209906992717,3cyclictest171rcu_preempt07:25:250
1209906992711,3cyclictest171rcu_preempt07:40:290
120990899266,14cyclictest1001-21mta-sts-daemon07:55:252
1209908992612,12cyclictest351ktimers/207:20:282
1209908992612,12cyclictest351ktimers/207:20:282
120990799262,18cyclictest665-21snmpd08:25:301
1209907992619,5cyclictest1226901-21cpuspeed08:05:141
1209907992518,4cyclictest1238433-21cron08:45:011
1209907992517,4cyclictest0-21swapper/108:00:251
120990799251,19cyclictest423721-21cupsd07:25:211
1209908992416,5cyclictest1-21systemd07:26:452
1209908992413,7cyclictest265-21systemd-journal08:20:232
1209908992216,3cyclictest0-21swapper/208:50:222
120990999191,8cyclictest0-21swapper/310:40:273
120990999191,8cyclictest0-21swapper/310:40:273
120990999172,7cyclictest0-21swapper/308:40:243
120990999164,6cyclictest0-21swapper/309:58:043
120990999163,5cyclictest0-21swapper/310:20:233
120990999162,6cyclictest0-21swapper/312:15:263
120990999162,6cyclictest0-21swapper/311:05:233
120990999161,8cyclictest0-21swapper/311:45:293
120990999161,7cyclictest0-21swapper/311:10:303
120990999161,7cyclictest0-21swapper/309:45:213
120990999161,7cyclictest0-21swapper/309:20:223
120990999153,6cyclictest0-21swapper/311:55:223
120990999152,6cyclictest0-21swapper/307:15:313
120990999151,9cyclictest0-21swapper/311:20:233
120990999151,8cyclictest0-21swapper/310:25:253
120990999151,8cyclictest0-21swapper/309:35:253
120990999151,7cyclictest0-21swapper/312:10:253
120990999151,7cyclictest0-21swapper/310:00:253
120990999151,7cyclictest0-21swapper/308:55:273
120990999151,7cyclictest0-21swapper/307:40:273
120990999151,6cyclictest0-21swapper/308:20:233
120990999143,5cyclictest0-21swapper/310:45:263
120990999143,5cyclictest0-21swapper/309:25:253
120990999142,7cyclictest0-21swapper/311:25:223
120990999141,9cyclictest0-21swapper/310:40:023
120990999141,9cyclictest0-21swapper/310:40:023
120990999141,8cyclictest0-21swapper/312:35:253
120990999141,8cyclictest0-21swapper/310:15:243
120990999141,8cyclictest0-21swapper/310:10:233
120990999141,7cyclictest0-21swapper/311:15:283
120990999141,7cyclictest0-21swapper/310:30:303
120990999141,6cyclictest0-21swapper/310:50:223
120990999141,6cyclictest0-21swapper/310:50:223
120990999141,6cyclictest0-21swapper/308:25:253
120990999141,6cyclictest0-21swapper/308:05:223
120990999141,6cyclictest0-21swapper/307:30:243
120990999141,6cyclictest0-21swapper/307:20:223
120990999141,6cyclictest0-21swapper/307:20:223
120990999141,5cyclictest0-21swapper/308:00:233
120990999140,6cyclictest0-21swapper/309:40:223
120990999132,6cyclictest0-21swapper/307:45:243
120990999131,7cyclictest0-21swapper/312:00:353
120990999131,7cyclictest0-21swapper/311:35:243
120990999131,6cyclictest0-21swapper/309:30:223
120990999131,6cyclictest0-21swapper/309:05:273
120990999131,6cyclictest0-21swapper/307:55:223
120990999131,5cyclictest0-21swapper/309:00:233
120990999123,4cyclictest0-21swapper/308:15:223
120990999122,6cyclictest0-21swapper/312:30:223
120990999122,6cyclictest0-21swapper/309:15:233
120990999122,6cyclictest0-21swapper/308:45:223
120990999121,7cyclictest0-21swapper/312:25:033
120990999121,6cyclictest0-21swapper/311:30:243
120990999121,6cyclictest0-21swapper/310:05:233
120990999121,5cyclictest0-21swapper/308:10:253
120990999112,6cyclictest0-21swapper/312:10:023
120990999112,5cyclictest0-21swapper/307:55:013
120990999111,7cyclictest0-21swapper/309:50:263
120990999111,6cyclictest0-21swapper/310:55:223
120990999111,6cyclictest0-21swapper/308:35:173
120990999111,5cyclictest0-21swapper/307:10:223
120990999101,5cyclictest0-21swapper/311:40:163
120990999101,5cyclictest0-21swapper/311:00:143
120990999101,5cyclictest0-21swapper/309:10:123
120990999101,5cyclictest0-21swapper/308:50:223
120990999101,5cyclictest0-21swapper/307:25:203
12099099991,5cyclictest0-21swapper/312:25:303
12099099991,5cyclictest0-21swapper/311:50:123
12099099991,4cyclictest0-21swapper/307:10:023
12099099990,5cyclictest0-21swapper/307:35:173
12099099983,3cyclictest0-21swapper/308:30:243
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional