You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-21 - 03:37

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackeslot5s.osadl.org (updated Tue Apr 21, 2026 00:44:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
12339992522,2cyclictest7291-21ssh22:45:142
12339992521,1cyclictest1921-21rm22:08:492
1233999250,25cyclictest0-21swapper/221:32:062
12331992523,1cyclictest0-21swapper/021:45:460
12331992520,4cyclictest5992-21diskmemload22:33:550
12331992520,4cyclictest0-21swapper/022:05:080
12331992520,4cyclictest0-21swapper/000:00:130
1233199250,24cyclictest0-21swapper/023:17:200
1233199250,24cyclictest0-21swapper/022:42:160
1233199250,1cyclictest0-21swapper/021:39:130
1234299240,24cyclictest0-21swapper/323:54:123
1234299240,24cyclictest0-21swapper/322:42:533
12339992423,0cyclictest0-21swapper/222:35:272
12339992421,2cyclictest16754-21ssh22:23:062
1233999240,1cyclictest27744-1kworker/u9:223:18:552
12335992422,1cyclictest0-21swapper/123:25:501
12335992422,1cyclictest0-21swapper/123:15:101
12335992421,2cyclictest13707-21sh22:51:331
1233599241,22cyclictest23561-21apt-get20:40:021
1233599240,24cyclictest0-21swapper/100:13:171
1233599240,23cyclictest789-21awk22:40:011
1233599240,23cyclictest20607-21ssh21:23:531
1233599240,23cyclictest11372-21apt-get00:25:081
1233599240,23cyclictest0-21swapper/122:26:311
1233599240,23cyclictest0-21swapper/121:25:131
1233599240,1cyclictest26079-21ssh22:31:511
12331992421,3cyclictest0-21swapper/023:00:090
12331992420,4cyclictest5992-21diskmemload00:25:100
1233199240,24cyclictest5992-21diskmemload22:59:260
1233199240,23cyclictest5992-21diskmemload22:37:160
1233199240,23cyclictest0-21swapper/021:17:270
1233199240,23cyclictest0-21swapper/021:10:100
1233199240,21cyclictest0-21swapper/023:57:230
1233199240,20cyclictest10864-21rm22:16:540
1233199240,0cyclictest11044-21ssh23:52:480
1233199240,0cyclictest0-21swapper/023:47:410
1233199240,0cyclictest0-21swapper/023:32:440
1233199240,0cyclictest0-21swapper/021:56:200
1233199240,0cyclictest0-21swapper/021:21:330
1233199240,0cyclictest0-21swapper/000:38:390
1233199240,0cyclictest0-21swapper/000:24:500
12342992323,0cyclictest0-21swapper/323:56:223
12342992323,0cyclictest0-21swapper/322:52:093
12342992323,0cyclictest0-21swapper/322:25:323
12342992323,0cyclictest0-21swapper/322:24:153
12342992323,0cyclictest0-21swapper/321:35:523
12342992323,0cyclictest0-21swapper/300:25:483
12342992323,0cyclictest0-21swapper/300:09:313
12342992322,1cyclictest0-21swapper/321:15:083
12342992321,1cyclictest5992-21diskmemload21:52:453
12342992321,1cyclictest18278-21users00:30:203
12342992321,1cyclictest0-21swapper/323:44:123
12342992320,2cyclictest24217-21sh21:59:023
1234299230,23cyclictest0-21swapper/323:36:323
1234299230,23cyclictest0-21swapper/300:17:483
1234299230,22cyclictest9613-21latency_hist21:45:013
1234299230,22cyclictest8477-21sh00:20:553
1234299230,22cyclictest6013-21ssh23:15:173
1234299230,22cyclictest30463-21sh22:35:433
1234299230,22cyclictest2730-21cron22:10:003
1234299230,22cyclictest25809-21sh23:04:403
1234299230,22cyclictest20447-21sh21:23:393
1234299230,22cyclictest12749-21ssh21:46:473
1234299230,22cyclictest0-21swapper/322:15:123
12339992323,0cyclictest5992-21diskmemload22:11:212
12339992323,0cyclictest0-21swapper/222:52:372
12339992323,0cyclictest0-21swapper/222:15:152
12339992323,0cyclictest0-21swapper/221:20:272
12339992323,0cyclictest0-21swapper/221:17:542
12339992323,0cyclictest0-21swapper/200:07:442
12339992321,1cyclictest4214-21ssh00:17:162
12339992320,2cyclictest29980-21ssh23:40:082
1233999230,23cyclictest0-21swapper/222:59:512
1233999230,23cyclictest0-21swapper/222:29:232
1233999230,22cyclictest3959-21apt20:00:012
1233999230,22cyclictest2708-21ssh23:12:372
1233999230,22cyclictest24757-21ssh23:35:072
1233999230,22cyclictest21743-21grep00:35:102
1233999230,0cyclictest5992-21diskmemload23:25:442
1233999230,0cyclictest5992-21diskmemload23:21:292
1233999230,0cyclictest5992-21diskmemload21:10:272
1233999230,0cyclictest0-21swapper/223:47:412
1233999230,0cyclictest0-21swapper/200:25:152
1233999230,0cyclictest0-21swapper/200:22:082
12335992323,0cyclictest0-21swapper/122:44:411
12335992323,0cyclictest0-21swapper/121:42:401
1233599231,21cyclictest21492-21users23:30:171
1233599230,2cyclictest11605-21ssh21:45:171
1233599230,23cyclictest0-21swapper/121:36:201
1233599230,23cyclictest0-21swapper/100:23:421
1233599230,23cyclictest0-21swapper/100:16:031
1233599230,22cyclictest6057-21ssh22:45:031
1233599230,22cyclictest26845-21ssh23:35:361
1233599230,22cyclictest25015-21ssh23:03:201
1233599230,22cyclictest18988-21dpkg20:30:021
1233599230,22cyclictest0-21swapper/123:57:041
1233599230,22cyclictest0-21swapper/123:20:111
1233599230,0cyclictest0-21swapper/122:21:351
12331992323,0cyclictest0-21swapper/023:20:290
12331992323,0cyclictest0-21swapper/023:10:250
12331992323,0cyclictest0-21swapper/000:15:110
12331992322,1cyclictest0-21swapper/021:54:460
12331992321,2cyclictest9851-21ssh22:48:250
12331992320,3cyclictest0-21swapper/022:00:010
12331992319,3cyclictest5992-21diskmemload22:26:240
1233199230,23cyclictest0-21swapper/022:20:180
1233199230,23cyclictest0-21swapper/021:29:060
1233199230,22cyclictest29182-21sh21:30:440
1233199230,22cyclictest16402-21apt-get00:30:090
1233199230,22cyclictest0-21swapper/021:42:500
1233199230,19cyclictest29870-21apt-get23:40:080
1233199230,0cyclictest5992-21diskmemload00:10:550
1233199230,0cyclictest0-21swapper/023:29:140
1233199230,0cyclictest0-21swapper/023:08:340
12342992222,0cyclictest5992-21diskmemload21:27:473
12342992222,0cyclictest5992-21diskmemload00:00:143
12342992222,0cyclictest0-21swapper/320:00:093
12342992221,1cyclictest5992-21diskmemload23:07:213
12342992220,1cyclictest28111-21apt-get00:10:073
12342992220,1cyclictest14692-21cron19:15:013
12342992220,1cyclictest14692-21cron19:15:013
12342992220,1cyclictest1198-21idleruntime-cro21:00:013
12342992220,1cyclictest10077-21df23:20:113
12342992219,2cyclictest5990-21sh21:10:003
1234299220,2cyclictest19044-21sh22:56:493
1234299220,21cyclictest5992-21diskmemload22:45:043
1234299220,21cyclictest27423-21runrttasks22:00:583
1234299220,21cyclictest25522-21ssh22:30:533
1234299220,21cyclictest23573-21sendmail-msp20:40:003
1234299220,21cyclictest1777-21ssh23:11:063
1234299220,21cyclictest1536-21sh19:55:003
1234299220,21cyclictest11163-21latency_hist20:15:013
1234299220,21cyclictest0-21swapper/322:10:453
1234299220,21cyclictest0-21swapper/321:30:083
1234299220,21cyclictest0-21swapper/319:55:083
1234299220,21cyclictest0-21swapper/300:35:113
1234299220,1cyclictest9199-21ssh21:11:573
1234299220,1cyclictest8750-21basename20:10:013
1234299220,1cyclictest5992-21diskmemload23:30:053
1234299220,1cyclictest18377-21grep20:30:003
1234299220,1cyclictest0-21swapper/323:45:193
12339992222,0cyclictest5992-21diskmemload00:10:492
12339992220,1cyclictest26737-21idleruntime-cro19:40:002
12339992220,1cyclictest19777-21apt-get19:25:072
12339992220,1cyclictest18687-21ssh00:30:552
12339992220,1cyclictest0-21swapper/221:25:182
12339992218,0cyclictest0-21swapper/222:00:042
1233999220,2cyclictest15237-21expr21:50:092
1233999220,22cyclictest27335-21ssh22:33:552
1233999220,21cyclictest9922-21apt-get21:45:082
1233999220,21cyclictest5992-21diskmemload23:50:092
1233999220,21cyclictest3839-21ssh22:41:452
1233999220,21cyclictest26066-21apt-get23:05:022
1233999220,1cyclictest23426-21ssh21:57:402
1233999220,1cyclictest1208-21kworker/u8:221:40:192
1233999220,1cyclictest0-21swapper/223:55:082
1233999220,1cyclictest0-21swapper/223:01:432
1233999220,1cyclictest0-21swapper/221:35:102
1233999220,0cyclictest0-21swapper/223:34:252
12335992221,1cyclictest5992-21diskmemload22:01:501
12335992221,1cyclictest0-21swapper/123:50:081
12335992220,1cyclictest0-21swapper/121:50:201
12335992220,1cyclictest0-21swapper/121:15:051
12335992220,1cyclictest0-21swapper/121:10:151
1233599220,22cyclictest0-21swapper/123:45:571
1233599220,22cyclictest0-21swapper/123:07:141
1233599220,22cyclictest0-21swapper/100:32:331
1233599220,21cyclictest5992-21diskmemload22:15:051
1233599220,21cyclictest3077-21apt-get22:10:081
1233599220,21cyclictest30303-21apt-get22:05:081
1233599220,21cyclictest24817-21sh21:59:561
1233599220,21cyclictest23096-21apt-get00:05:101
1233599220,21cyclictest19943-21ssh00:00:351
1233599220,21cyclictest0-21swapper/119:50:071
1233599220,21cyclictest0-21swapper/119:25:011
1233599220,21cyclictest0-21swapper/100:35:431
1233599220,1cyclictest3958-21turbostat.cron20:00:011
1233599220,1cyclictest29110-21latency_hist19:45:001
1233599220,1cyclictest0-21swapper/119:20:011
1233599220,0cyclictest0-21swapper/123:12:091
12331992222,0cyclictest0-21swapper/022:11:180
12331992222,0cyclictest0-21swapper/020:40:000
12331992220,2cyclictest0-21swapper/023:36:230
12331992220,2cyclictest0-21swapper/000:05:060
12331992220,1cyclictest313-21systemd-journal19:30:010
12331992220,1cyclictest24573-21apt-get19:35:090
12331992220,1cyclictest24305-21perf19:35:000
1233199220,21cyclictest19512-21awk19:25:010
1233199220,21cyclictest0-21swapper/022:50:140
1233199220,21cyclictest0-21swapper/019:45:100
1233199220,1cyclictest11418-21apt-get20:15:090
12342992120,0cyclictest0-21swapper/319:40:073
12342992119,1cyclictest21908-21awk19:30:013
1234299210,20cyclictest0-21swapper/319:30:083
1234299210,0cyclictest5992-21diskmemload23:27:523
12339992121,0cyclictest0-21swapper/220:05:082
12339992121,0cyclictest0-21swapper/200:00:192
1233999210,20cyclictest19029-21apt-get20:30:092
1233999210,20cyclictest1471-21apt-get21:00:092
1233999210,1cyclictest31508-21awk19:50:002
1233999210,0cyclictest0-21swapper/220:45:062
1233599210,21cyclictest0-21swapper/121:30:111
1233599210,0cyclictest0-21swapper/123:40:081
1233599210,0cyclictest0-21swapper/122:55:241
1233599210,0cyclictest0-21swapper/120:25:101
12331992119,1cyclictest26367-21idleruntime-cro20:45:010
1233199210,0cyclictest0-21swapper/020:55:080
1233199210,0cyclictest0-21swapper/020:00:090
1234299200,0cyclictest0-21swapper/320:15:093
1233999200,0cyclictest22173-21apt-get19:30:082
1233999200,0cyclictest12568-21apt-get19:10:072
1233999200,0cyclictest12568-21apt-get19:10:072
12335992020,0cyclictest0-21swapper/120:05:081
1233599200,0cyclictest0-21swapper/121:05:081
1233599200,0cyclictest0-21swapper/120:35:081
12331992020,0cyclictest6629-21apt-get20:05:080
12331992020,0cyclictest0-21swapper/021:00:080
12331992020,0cyclictest0-21swapper/020:30:090
12331992020,0cyclictest0-21swapper/019:10:060
12331992020,0cyclictest0-21swapper/019:10:060
12331992019,1cyclictest0-21swapper/020:10:080
12331992016,4cyclictest0-21swapper/019:40:070
1233199200,0cyclictest15986-21perf20:25:000
12342991919,0cyclictest0-21swapper/320:40:083
12342991917,1cyclictest619-21polkitd19:50:003
1234299190,0cyclictest0-21swapper/320:20:073
12339991919,0cyclictest4234-21apt-get20:00:092
12339991918,0cyclictest24238-21apt-get20:40:082
12335991917,1cyclictest29028-21apt-get20:50:081
12335991917,1cyclictest0-21swapper/120:10:081
12331991919,0cyclictest16242-21apt-get20:25:110
12331991919,0cyclictest0-21swapper/020:45:060
12335991818,0cyclictest0-21swapper/119:45:101
12335991818,0cyclictest0-21swapper/119:35:091
12335991816,1cyclictest26631-21apt-get20:45:061
1233599180,0cyclictest0-21swapper/120:55:081
12331991818,0cyclictest0-21swapper/019:15:070
12342991717,0cyclictest0-21swapper/319:20:083
12339991717,0cyclictest0-21swapper/220:55:082
12339991717,0cyclictest0-21swapper/220:10:082
12339991714,2cyclictest31140-21idleruntime-cro20:55:012
1233599170,15cyclictest2629-21cut21:00:151
12331991717,0cyclictest0-21swapper/019:50:080
12342991616,0cyclictest29028-21apt-get20:50:083
12342991616,0cyclictest0-21swapper/320:45:063
12342991616,0cyclictest0-21swapper/320:30:093
12342991614,1cyclictest26733-21munin-run19:40:003
12339991616,0cyclictest0-21swapper/220:25:112
12339991615,1cyclictest6018-21perf21:10:002
12339991614,1cyclictest22729-21grep20:35:152
1233999160,0cyclictest0-21swapper/219:40:072
12335991616,0cyclictest0-21swapper/120:00:091
12331991616,0cyclictest0-21swapper/021:05:080
12342991515,0cyclictest0-21swapper/321:00:093
1234299150,1cyclictest0-21swapper/319:15:093
12339991515,0cyclictest0-21swapper/220:20:072
12339991513,1cyclictest31487-21cron19:50:012
1233999150,1cyclictest19531-21perf19:25:012
1233599150,14cyclictest0-21swapper/120:20:141
1233999140,14cyclictest0-21swapper/219:16:072
12335991414,0cyclictest0-21swapper/119:30:081
1233199140,0cyclictest0-21swapper/020:50:060
1233199140,0cyclictest0-21swapper/019:55:540
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional