You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-13 - 12:50

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackeslot5s.osadl.org (updated Sat Jun 13, 2026 00:44:21)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2031199293,22cyclictest13-21ksoftirqd/000:30:010
2031599280,1cyclictest0-21swapper/122:09:401
2031599270,1cyclictest0-21swapper/100:30:011
20315992623,3cyclictest0-21swapper/123:32:441
20315992619,6cyclictest16019-21apt-get23:14:331
2031599260,2cyclictest31788-21sh23:28:401
2031599260,25cyclictest25944-21sh21:21:291
2031599260,25cyclictest24725-21ssh23:51:411
2031199260,25cyclictest13573-21diskmemload00:09:380
2032199250,24cyclictest21396-21apt-get23:49:343
2032199250,24cyclictest0-21swapper/300:25:023
2032199250,1cyclictest0-21swapper/322:29:313
2031999250,24cyclictest12573-21ssh23:09:472
20315992523,2cyclictest0-21swapper/123:05:211
20315992518,6cyclictest7552-21cut00:35:011
2031599250,21cyclictest0-21swapper/123:44:091
2032199240,24cyclictest0-21swapper/322:19:173
2032199240,23cyclictest13573-21diskmemload23:17:413
2032199240,23cyclictest0-21swapper/323:23:513
2032199240,0cyclictest0-21swapper/300:09:483
20319992419,2cyclictest0-21swapper/222:31:062
2031999240,24cyclictest13573-21diskmemload22:07:372
2031999240,23cyclictest13573-21diskmemload00:39:442
2031999240,23cyclictest0-21swapper/222:10:432
2031999240,23cyclictest0-21swapper/221:46:182
2031999240,23cyclictest0-21swapper/221:29:572
2031999240,23cyclictest0-21swapper/200:02:312
20315992422,2cyclictest0-21swapper/100:17:491
20315992421,3cyclictest0-21swapper/122:17:491
20315992420,3cyclictest0-21swapper/123:57:451
20315992420,3cyclictest0-21swapper/122:42:281
2031599240,24cyclictest32245-21ssh22:28:431
2031599240,23cyclictest13573-21diskmemload22:56:591
2031599240,23cyclictest0-21swapper/121:26:321
2031599240,21cyclictest0-21swapper/123:23:411
2031599240,20cyclictest0-21swapper/121:48:331
2031599240,0cyclictest0-21swapper/121:59:541
2031599240,0cyclictest0-21swapper/121:43:461
2031599240,0cyclictest0-21swapper/121:32:481
2031599240,0cyclictest0-21swapper/100:12:531
2031599240,0cyclictest0-21swapper/100:05:071
20311992423,1cyclictest0-21swapper/021:32:500
20311992421,2cyclictest8124-21ssh23:35:440
20311992421,2cyclictest0-21swapper/023:56:530
2031199240,2cyclictest26752-21perf20:30:010
2031199240,23cyclictest13573-21diskmemload22:36:220
2031199240,23cyclictest0-21swapper/023:54:340
2031199240,23cyclictest0-21swapper/022:23:120
2031199240,0cyclictest0-21swapper/022:49:340
2031199240,0cyclictest0-21swapper/022:49:340
20321992323,0cyclictest0-21swapper/322:36:063
20321992323,0cyclictest0-21swapper/322:14:243
20321992323,0cyclictest0-21swapper/322:05:293
20321992323,0cyclictest0-21swapper/321:42:373
20321992321,1cyclictest12546-21ssh23:39:453
20321992321,1cyclictest0-21swapper/323:52:173
20321992321,0cyclictest151rcu_preempt23:32:343
20321992320,2cyclictest24359-21latency_hist20:25:013
2032199230,2cyclictest8287-21sh21:34:493
2032199230,2cyclictest26811-21sh22:23:363
2032199230,23cyclictest0-21swapper/300:10:413
2032199230,22cyclictest2666-21chrt22:30:033
2032199230,22cyclictest24055-21sh00:20:423
2032199230,1cyclictest13573-21diskmemload22:45:403
2032199230,1cyclictest13573-21diskmemload22:45:403
2032199230,1cyclictest0-21swapper/321:50:423
2032199230,0cyclictest13573-21diskmemload22:50:233
2032199230,0cyclictest13573-21diskmemload21:10:363
2032199230,0cyclictest0-21swapper/323:41:583
2032199230,0cyclictest0-21swapper/322:58:043
2032199230,0cyclictest0-21swapper/322:01:453
20319992323,0cyclictest0-21swapper/222:46:592
20319992323,0cyclictest0-21swapper/222:46:592
20319992323,0cyclictest0-21swapper/221:30:182
20319992323,0cyclictest0-21swapper/221:23:522
20319992323,0cyclictest0-21swapper/221:17:422
20319992321,1cyclictest7996-21sh22:35:012
20319992321,1cyclictest0-21swapper/223:39:582
20319992321,1cyclictest0-21swapper/222:57:492
20319992319,4cyclictest0-21swapper/223:18:022
2031999230,23cyclictest13573-21diskmemload22:52:102
2031999230,23cyclictest0-21swapper/223:22:562
2031999230,22cyclictest7484-21perf19:50:012
2031999230,22cyclictest4632-21rm22:02:252
2031999230,22cyclictest29804-21ssh23:25:392
2031999230,22cyclictest25801-21rm23:53:212
2031999230,22cyclictest24999-21sh21:50:142
2031999230,22cyclictest19004-21ssh00:16:062
2031999230,22cyclictest1684-40mandb00:00:002
2031999230,0cyclictest13573-21diskmemload22:41:132
2031999230,0cyclictest0-21swapper/223:11:182
20315992323,0cyclictest0-21swapper/123:38:001
20315992323,0cyclictest0-21swapper/122:12:391
20315992322,1cyclictest13573-21diskmemload22:36:401
20315992320,3cyclictest13573-21diskmemload23:00:461
20315992320,3cyclictest0-21swapper/121:36:141
20315992320,3cyclictest0-21swapper/121:11:271
20315992320,2cyclictest21294-21ssh23:49:241
20315992319,4cyclictest0-21swapper/119:49:331
2031599230,23cyclictest0-21swapper/122:02:051
2031599230,22cyclictest3415-21sh22:31:031
2031599230,22cyclictest19852-21ssh21:15:231
20311992323,0cyclictest13573-21diskmemload22:04:290
20311992323,0cyclictest0-21swapper/023:46:070
20311992323,0cyclictest0-21swapper/021:18:460
20311992321,1cyclictest23900-21sh00:20:290
20311992321,1cyclictest0-21swapper/022:44:350
20311992321,1cyclictest0-21swapper/000:18:020
20311992321,1cyclictest0-21swapper/000:04:350
2031199230,23cyclictest62550irq/127-eno123:16:180
2031199230,23cyclictest0-21swapper/023:42:090
2031199230,23cyclictest0-21swapper/023:12:390
2031199230,23cyclictest0-21swapper/023:05:360
2031199230,23cyclictest0-21swapper/022:25:320
2031199230,23cyclictest0-21swapper/021:46:580
2031199230,22cyclictest31688-21ssh23:28:310
2031199230,22cyclictest29657-21ssh22:55:170
2031199230,22cyclictest25157-21ssh21:20:150
2031199230,22cyclictest13573-21diskmemload21:40:020
2031199230,22cyclictest0-21swapper/022:51:140
2031199230,22cyclictest0-21swapper/022:12:440
2031199230,22cyclictest0-21swapper/021:10:500
2031199230,0cyclictest13573-21diskmemload00:14:190
2031199230,0cyclictest0-21swapper/023:00:190
2031199230,0cyclictest0-21swapper/021:35:040
20321992222,0cyclictest0-21swapper/322:42:193
20321992222,0cyclictest0-21swapper/300:37:143
20321992221,1cyclictest2941-21kworker/u8:121:21:243
20321992220,1cyclictest19599-21sh21:15:023
20321992220,1cyclictest0-21swapper/300:30:363
2032199220,21cyclictest27355-21apt-get20:34:333
2032199220,21cyclictest20354-21ssh21:46:173
2032199220,21cyclictest0-21swapper/323:25:473
2032199220,21cyclictest0-21swapper/323:10:163
2032199220,21cyclictest0-21swapper/323:01:143
2032199220,21cyclictest0-21swapper/321:56:053
2032199220,21cyclictest0-21swapper/321:25:263
2032199220,21cyclictest0-21swapper/320:04:343
2032199220,21cyclictest0-21swapper/300:02:043
2032199220,1cyclictest8962-21ssh21:35:233
2032199220,1cyclictest0-21swapper/323:05:393
2032199220,0cyclictest0-21swapper/300:17:503
20319992222,0cyclictest13573-21diskmemload00:11:532
20319992222,0cyclictest0-21swapper/223:30:562
20319992222,0cyclictest0-21swapper/200:26:432
20319992222,0cyclictest0-21swapper/200:05:282
20319992221,1cyclictest13573-21diskmemload21:40:042
20319992220,1cyclictest30306-21munin-run19:30:012
2031999220,21cyclictest24687-21ssh22:20:222
2031999220,21cyclictest1552-21munin-run20:45:002
2031999220,21cyclictest13573-21diskmemload21:55:512
2031999220,21cyclictest13573-21diskmemload00:30:302
2031999220,21cyclictest10344-21sh21:37:212
2031999220,21cyclictest0-21swapper/223:00:292
2031999220,21cyclictest0-21swapper/222:25:182
2031999220,1cyclictest3956-21perf20:50:002
2031999220,1cyclictest20040-21ssh22:16:232
2031999220,1cyclictest0-21swapper/200:20:492
2031999220,0cyclictest0-21swapper/221:11:472
2031599221,0cyclictest11805-21apt-get21:09:331
2031599220,21cyclictest8094-21apt-get19:54:341
2031599220,21cyclictest0-21swapper/123:16:281
2031599220,21cyclictest0-21swapper/119:59:331
2031599220,21cyclictest0-21swapper/100:00:051
2031599220,1cyclictest27672-21ssh21:54:211
20311992221,1cyclictest62550irq/127-eno121:26:270
20311992221,1cyclictest0-21swapper/021:50:130
20311992220,1cyclictest2670-21sh19:40:010
20311992220,1cyclictest0-21swapper/022:31:030
20311992220,1cyclictest0-21swapper/000:35:090
2031199220,22cyclictest3574-21rm00:31:550
2031199220,21cyclictest0-21swapper/020:04:340
2031199220,1cyclictest0-21swapper/023:32:030
2031199220,1cyclictest0-21swapper/022:06:370
2031199220,0cyclictest13573-21diskmemload22:16:350
2031199220,0cyclictest0-21swapper/021:57:510
2031199220,0cyclictest0-21swapper/020:09:330
20321992118,2cyclictest29028-21rm23:55:063
2032199210,21cyclictest0-21swapper/319:14:333
2032199210,20cyclictest0-21swapper/321:04:343
20319992121,0cyclictest0-21swapper/223:45:142
20319992120,1cyclictest12956-21apt-get20:04:342
20319992120,1cyclictest0-21swapper/219:10:012
2031999210,21cyclictest0-21swapper/220:34:332
2031999210,20cyclictest32703-21grep19:35:012
2031999210,20cyclictest29754-21apt-get20:39:332
2031999210,20cyclictest24956-21apt-get20:29:332
20315992121,0cyclictest6944-21apt-get20:59:331
20315992121,0cyclictest0-21swapper/100:35:441
20315992120,1cyclictest15348-21apt-get20:09:331
2031599210,0cyclictest2152-21apt-get20:49:321
20311992120,1cyclictest13573-21diskmemload23:20:130
20311992120,1cyclictest0-21swapper/019:24:330
20311992120,0cyclictest0-21swapper/020:14:320
2031199210,20cyclictest0-21swapper/019:49:330
2031199210,0cyclictest32170-21apt-get20:44:330
20321992020,0cyclictest0-21swapper/320:49:323
20321992020,0cyclictest0-21swapper/320:29:333
20321992020,0cyclictest0-21swapper/319:44:333
2032199200,0cyclictest0-21swapper/320:54:343
20319992019,1cyclictest872-21apt-get19:39:312
20319992019,1cyclictest4551-21apt-get20:54:342
20319992019,1cyclictest22560-21apt-get20:24:322
20319992019,1cyclictest17742-21apt-get20:14:322
20319992018,1cyclictest17150-21munin-run20:10:002
20319992017,2cyclictest21918-21cron20:20:012
2031999200,20cyclictest0-21swapper/219:59:332
2031999200,0cyclictest0-21swapper/220:59:332
20315992020,0cyclictest0-21swapper/120:29:341
20315992020,0cyclictest0-21swapper/119:44:331
20315992020,0cyclictest0-21swapper/119:14:331
20315992018,1cyclictest2692-21awk19:40:011
2031599200,19cyclictest31516-21cron20:40:011
2031599200,0cyclictest0-21swapper/121:04:341
2031599200,0cyclictest0-21swapper/119:29:321
20311992018,1cyclictest3944-21apt20:50:000
2031199200,20cyclictest0-21swapper/019:54:330
20321991917,1cyclictest2703-21sendmail-msp19:40:013
20315991919,0cyclictest0-21swapper/120:44:321
2031599190,1cyclictest23689-21apt-get19:19:321
2031599190,13cyclictest783-21snmpd20:54:411
20311991919,0cyclictest0-21swapper/021:09:330
20311991919,0cyclictest0-21swapper/020:39:330
20311991919,0cyclictest0-21swapper/019:10:010
20311991917,1cyclictest25483-21idleruntime-cro19:20:000
20321991818,0cyclictest0-21swapper/319:54:343
20315991818,0cyclictest0-21swapper/120:19:311
2031199186,11cyclictest0-21swapper/021:04:340
20311991818,0cyclictest0-21swapper/020:59:330
20311991818,0cyclictest0-21swapper/019:44:330
20311991818,0cyclictest0-21swapper/019:34:330
20321991717,0cyclictest0-21swapper/320:14:333
20321991717,0cyclictest0-21swapper/319:49:333
20321991717,0cyclictest0-21swapper/319:24:333
20321991714,2cyclictest31546-21awk20:40:013
20315991714,2cyclictest14674-21users20:04:431
20321991615,1cyclictest20135-21apt-get20:19:323
20321991615,1cyclictest10540-21apt-get19:59:333
20321991614,1cyclictest32707-21munin-run19:35:013
20319991616,0cyclictest0-21swapper/221:04:342
20315991614,1cyclictest18383-21hddtemp_smartct20:14:351
20311991616,0cyclictest0-21swapper/019:29:330
20311991614,1cyclictest21948-21perf20:20:010
20321991515,0cyclictest28500-21apt-get19:29:333
20321991515,0cyclictest0-21swapper/321:00:003
20319991515,0cyclictest0-21swapper/221:09:332
20319991515,0cyclictest0-21swapper/219:54:342
20319991515,0cyclictest0-21swapper/219:44:332
20315991515,0cyclictest0-21swapper/120:24:321
2032199140,14cyclictest0-21swapper/321:05:483
2032199140,14cyclictest0-21swapper/320:40:123
2032199140,14cyclictest0-21swapper/320:05:183
2032199140,14cyclictest0-21swapper/319:17:033
2031999140,14cyclictest0-21swapper/219:21:082
2031999140,0cyclictest0-21swapper/219:15:272
2031599140,14cyclictest0-21swapper/120:30:121
2031599140,14cyclictest0-21swapper/119:30:521
2031599140,0cyclictest0-21swapper/119:20:171
20311991414,0cyclictest0-21swapper/020:30:060
2031199140,14cyclictest0-21swapper/019:55:550
2031199140,0cyclictest0-21swapper/020:51:030
2031199140,0cyclictest0-21swapper/020:20:560
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional