You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-14 - 00:59

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot5s.osadl.org (updated Sun Sep 13, 2026 12:44:25)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
990899280,27cyclictest6023-21cron09:10:000
9908992721,5cyclictest28668-21apt-get11:27:120
9908992721,5cyclictest10295-21cron11:10:010
9908992623,3cyclictest0-21swapper/010:39:080
990899260,22cyclictest6031-21diskmemload09:26:350
990899260,0cyclictest0-21swapper/011:50:050
990899260,0cyclictest0-21swapper/010:09:470
990899260,0cyclictest0-21swapper/010:09:470
991699250,24cyclictest0-21swapper/210:29:332
991699250,24cyclictest0-21swapper/209:27:112
9911992523,1cyclictest14806-21ssh10:44:591
9911992523,1cyclictest0-21swapper/109:44:051
991199250,1cyclictest16648-21apt-get10:47:141
9908992525,0cyclictest6031-21diskmemload11:11:280
9908992521,4cyclictest0-21swapper/009:16:120
9908992521,4cyclictest0-21swapper/009:16:120
9908992521,3cyclictest0-21swapper/009:40:320
9908992520,4cyclictest13269-21apt-get08:22:120
990899250,24cyclictest6031-21diskmemload10:57:360
990899250,24cyclictest0-21swapper/011:22:290
990899250,24cyclictest0-21swapper/010:34:360
990899250,21cyclictest6031-21diskmemload09:54:190
990899250,1cyclictest7878-21sh12:06:440
990899250,0cyclictest6031-21diskmemload10:14:110
990899250,0cyclictest0-21swapper/008:42:120
9919992422,1cyclictest0-21swapper/309:26:373
9919992421,2cyclictest26028-21sh11:52:593
991999240,1cyclictest6031-21diskmemload11:47:233
991999240,0cyclictest0-21swapper/309:11:593
9916992423,1cyclictest6031-21diskmemload10:00:132
9916992422,1cyclictest0-21swapper/209:49:122
9916992420,3cyclictest31285-21apt-get08:57:112
991699240,24cyclictest0-21swapper/209:16:242
991699240,24cyclictest0-21swapper/209:16:242
9911992424,0cyclictest0-21swapper/112:08:161
9911992424,0cyclictest0-21swapper/110:00:031
9911992423,1cyclictest0-21swapper/112:01:111
9911992422,1cyclictest774-21runrttasks11:06:051
991199240,24cyclictest0-21swapper/111:47:421
991199240,1cyclictest6031-21diskmemload10:58:111
991199240,0cyclictest0-21swapper/110:33:251
991199240,0cyclictest0-21swapper/109:51:261
9908992421,3cyclictest0-21swapper/012:18:590
9908992420,4cyclictest26486-21ssh10:26:480
9908992420,3cyclictest6031-21diskmemload12:34:230
9908992419,4cyclictest6031-21diskmemload09:59:130
9908992418,5cyclictest0-21swapper/009:11:180
9908992417,6cyclictest0-21swapper/009:22:110
990899240,24cyclictest6031-21diskmemload10:44:410
990899240,24cyclictest0-21swapper/011:48:080
990899240,23cyclictest0-21swapper/012:03:430
990899240,1cyclictest0-21swapper/011:39:030
990899240,0cyclictest6031-21diskmemload11:30:170
990899240,0cyclictest6031-21diskmemload11:19:000
990899240,0cyclictest6031-21diskmemload10:46:500
990899240,0cyclictest0-21swapper/012:20:530
9919992323,0cyclictest0-21swapper/312:12:273
9919992323,0cyclictest0-21swapper/309:20:573
9919992321,1cyclictest4587-21ssh12:02:223
9919992321,1cyclictest30453-21diskmemload10:58:293
9919992321,1cyclictest0-21swapper/310:08:513
9919992321,1cyclictest0-21swapper/310:08:513
9919992320,2cyclictest2630-21sh09:35:373
9919992320,2cyclictest23301-21idleruntime-cro08:40:013
9919992320,2cyclictest14079-21ssh11:42:203
9919992320,2cyclictest14079-21ssh11:42:203
991999231,21cyclictest14206-21apt-get09:17:113
991999231,21cyclictest14206-21apt-get09:17:113
991999231,1cyclictest2186-21rm11:32:143
991999230,23cyclictest6031-21diskmemload11:16:033
991999230,23cyclictest6031-21diskmemload09:42:303
991999230,23cyclictest6031-21diskmemload09:30:093
991999230,23cyclictest4348-21ssh10:35:453
991999230,23cyclictest0-21swapper/312:37:453
991999230,23cyclictest0-21swapper/311:06:223
991999230,22cyclictest9995-21ssh11:38:523
991999230,22cyclictest31094-21sh10:01:163
991999230,22cyclictest29981-21ssh12:26:493
991999230,22cyclictest24094-21sh12:21:133
991999230,22cyclictest15255-21munin-plugin-st08:25:003
991999230,22cyclictest14963-21ssh10:16:033
991999230,22cyclictest0-21swapper/310:45:483
991999230,0cyclictest6031-21diskmemload09:54:433
991999230,0cyclictest0-21swapper/311:21:553
991999230,0cyclictest0-21swapper/311:12:203
991999230,0cyclictest0-21swapper/310:52:273
991999230,0cyclictest0-21swapper/309:47:183
9916992323,0cyclictest0-21swapper/212:30:012
9916992323,0cyclictest0-21swapper/211:15:022
9916992323,0cyclictest0-21swapper/211:12:332
9916992323,0cyclictest0-21swapper/211:05:052
9916992322,1cyclictest5262-21cron11:35:002
9916992322,1cyclictest26495-21apt-get08:47:122
9916992321,1cyclictest0-21swapper/211:41:112
9916992321,1cyclictest0-21swapper/211:41:112
9916992320,2cyclictest21985-21sh09:23:132
991699230,23cyclictest0-21swapper/211:37:262
991699230,22cyclictest6031-21diskmemload12:29:532
991699230,22cyclictest4604-21ssh10:06:572
991699230,22cyclictest4604-21ssh10:06:572
991699230,22cyclictest12599-21idleruntime-cro12:40:012
991699230,22cyclictest0-21swapper/210:56:132
991699230,22cyclictest0-21swapper/210:21:302
991699230,0cyclictest6031-21diskmemload10:10:392
991699230,0cyclictest6031-21diskmemload09:43:102
991699230,0cyclictest0-21swapper/211:57:322
9911992323,0cyclictest6031-21diskmemload10:10:071
9911992323,0cyclictest0-21swapper/112:30:161
9911992323,0cyclictest0-21swapper/112:17:061
9911992323,0cyclictest0-21swapper/111:42:141
9911992323,0cyclictest0-21swapper/111:42:141
9911992323,0cyclictest0-21swapper/111:18:191
9911992323,0cyclictest0-21swapper/109:28:231
9911992321,1cyclictest7885-21ssh10:38:131
9911992321,1cyclictest32744-21rm12:28:161
9911992321,1cyclictest32562-21sh11:30:061
9911992321,1cyclictest22223-21apt-get10:52:121
9911992321,1cyclictest0-21swapper/110:19:501
9911992320,2cyclictest28541-21awk12:25:001
991199230,23cyclictest6031-21diskmemload10:23:241
991199230,23cyclictest0-21swapper/111:55:271
991199230,22cyclictest0-21swapper/109:11:131
991199230,1cyclictest10030-21apt-get08:15:021
991199230,1cyclictest0-21swapper/112:35:241
991199230,0cyclictest0-21swapper/110:26:051
9908992320,3cyclictest0-21swapper/011:42:250
9908992320,3cyclictest0-21swapper/011:42:250
9908992320,3cyclictest0-21swapper/010:53:060
9908992320,3cyclictest0-21swapper/009:45:140
9908992320,3cyclictest0-21swapper/009:38:580
990899230,23cyclictest0-21swapper/012:27:040
990899230,23cyclictest0-21swapper/010:02:150
990899230,22cyclictest803-21sh11:59:460
990899230,22cyclictest3374-21ssh11:03:050
990899230,20cyclictest6031-21diskmemload10:22:020
990899230,0cyclictest6031-21diskmemload12:37:330
990899230,0cyclictest6031-21diskmemload09:33:540
9919992222,0cyclictest0-21swapper/312:06:553
9919992222,0cyclictest0-21swapper/311:02:153
9919992220,1cyclictest10008-21cron08:15:003
9919992220,1cyclictest0-21swapper/310:13:133
9919992220,1cyclictest0-21swapper/309:05:003
991999220,2cyclictest28769-21sh09:58:213
991999220,21cyclictest28228-21ssh11:55:083
991999220,21cyclictest27901-21ssh11:26:063
991999220,21cyclictest20228-21ssh10:20:453
991999220,21cyclictest10850-21apt-get08:17:133
991999220,1cyclictest3016-21rm12:31:413
991999220,1cyclictest2149-21ssh10:32:553
991999220,1cyclictest18380-21ssh12:15:463
991999220,1cyclictest10052-21ssh10:40:503
991999220,0cyclictest0-21swapper/310:27:063
9916992222,0cyclictest0-21swapper/212:16:312
9916992221,1cyclictest0-21swapper/209:57:172
9916992220,1cyclictest0-21swapper/210:46:352
9916992220,1cyclictest0-21swapper/207:15:012
991699220,22cyclictest32111-21sh10:32:032
991699220,22cyclictest0-21swapper/211:27:122
991699220,22cyclictest0-21swapper/209:32:052
991699220,21cyclictest7853-21dpkg08:10:022
991699220,21cyclictest6031-21diskmemload09:10:042
991699220,21cyclictest0-21swapper/212:21:412
991699220,21cyclictest0-21swapper/211:52:182
991699220,21cyclictest0-21swapper/210:35:272
991699220,21cyclictest0-21swapper/210:16:082
991699220,21cyclictest0-21swapper/209:35:172
991699220,21cyclictest0-21swapper/207:32:102
991699220,1cyclictest606-21dbus-daemon08:45:012
991699220,1cyclictest19410-21ssh09:50:322
991699220,1cyclictest0-21swapper/211:00:132
9911992222,0cyclictest6031-21diskmemload09:15:321
9911992222,0cyclictest6031-21diskmemload09:15:321
9911992222,0cyclictest0-21swapper/111:35:291
9911992222,0cyclictest0-21swapper/109:47:031
9911992222,0cyclictest0-21swapper/109:31:091
9911992222,0cyclictest0-21swapper/108:37:111
9911992221,1cyclictest0-21swapper/111:11:011
9911992221,0cyclictest0-21swapper/108:02:091
9911992220,1cyclictest8056-21apt-get08:12:121
9911992220,1cyclictest0-21swapper/111:20:411
9911992220,1cyclictest0-21swapper/107:22:091
991199220,21cyclictest0-21swapper/110:07:471
991199220,21cyclictest0-21swapper/110:07:471
991199220,21cyclictest0-21swapper/108:40:021
991199220,21cyclictest0-21swapper/108:30:021
991199220,21cyclictest0-21swapper/107:42:121
991199220,1cyclictest0-21swapper/111:51:391
991199220,1cyclictest0-21swapper/109:55:581
991199220,0cyclictest0-21swapper/111:00:461
991199220,0cyclictest0-21swapper/109:36:051
9908992220,1cyclictest28471-21perf08:50:000
9908992220,1cyclictest10028-21turbostat08:15:000
990899220,4cyclictest0-21swapper/008:00:010
990899220,3cyclictest0-21swapper/007:52:110
990899220,1cyclictest606-21dbus-daemon07:35:000
990899220,1cyclictest12687-21ssh12:10:360
990899220,1cyclictest0-21swapper/010:15:080
9919992119,1cyclictest15095-21perf07:20:003
9919992119,1cyclictest0-21swapper/307:25:003
991999210,20cyclictest28888-21apt-get08:52:103
9916992121,0cyclictest0-21swapper/211:45:272
9916992121,0cyclictest0-21swapper/207:55:082
991699210,21cyclictest0-21swapper/212:10:262
991699210,21cyclictest0-21swapper/212:05:212
991699210,21cyclictest0-21swapper/210:50:562
991699210,21cyclictest0-21swapper/208:22:122
991699210,20cyclictest21237-21apt-get08:37:122
991699210,1cyclictest0-21swapper/210:40:102
9911992120,1cyclictest29640-21apt-get07:50:011
9911992120,0cyclictest0-21swapper/109:00:021
991199210,21cyclictest0-21swapper/111:25:531
991199210,21cyclictest0-21swapper/107:12:111
991199210,0cyclictest0-21swapper/108:52:101
9908992121,0cyclictest0-21swapper/008:27:100
9908992119,1cyclictest0-21swapper/007:40:000
9908992117,4cyclictest0-21swapper/008:07:150
990899210,21cyclictest0-21swapper/008:35:020
9919992020,0cyclictest0-21swapper/308:47:123
9919992020,0cyclictest0-21swapper/307:52:123
9919992019,1cyclictest223012sleep307:35:003
9916992020,0cyclictest0-21swapper/207:27:132
9916992019,0cyclictest1683-21apt-get09:02:122
9916992018,1cyclictest15663-21apt-get08:27:112
9911992020,0cyclictest0-21swapper/109:07:121
9911992020,0cyclictest0-21swapper/108:47:121
9911992018,1cyclictest0-21swapper/107:50:021
991199200,0cyclictest22705-21apt-get07:37:091
991199200,0cyclictest0-21swapper/107:17:121
9908992020,0cyclictest0-21swapper/008:17:130
9908992020,0cyclictest0-21swapper/007:42:120
990899200,2cyclictest0-21swapper/008:52:110
990899200,20cyclictest0-21swapper/009:02:120
990899200,20cyclictest0-21swapper/007:15:010
990899200,0cyclictest0-21swapper/008:32:120
990899200,0cyclictest0-21swapper/007:47:110
9919991919,0cyclictest0-21swapper/307:37:093
9919991918,0cyclictest0-21swapper/308:02:093
9916991919,0cyclictest0-21swapper/207:50:022
9911991917,1cyclictest2401-21cron08:00:011
9908991919,0cyclictest0-21swapper/007:12:110
9919991817,1cyclictest0-21swapper/308:57:113
9916991818,0cyclictest6031-21diskmemload09:10:002
9916991818,0cyclictest0-21swapper/207:37:092
9911991818,0cyclictest0-21swapper/108:57:111
9919991717,0cyclictest17920-21apt-get07:27:133
9919991717,0cyclictest0-21swapper/308:07:153
9919991716,1cyclictest17626-21apt-get08:30:023
9916991717,0cyclictest0-21swapper/208:52:102
9916991716,1cyclictest0-21swapper/208:30:022
9916991716,0cyclictest0-21swapper/207:42:122
9916991715,1cyclictest10311-21apt-get07:12:112
9911991716,0cyclictest0-21swapper/107:32:111
990899172,2cyclictest5036-21latency_hist08:05:000
990899171,15cyclictest0-21swapper/007:22:090
990899170,3cyclictest0-21swapper/008:57:270
990899170,16cyclictest0-21swapper/007:27:130
9919991616,0cyclictest0-21swapper/309:07:113
9919991616,0cyclictest0-21swapper/308:27:113
9919991616,0cyclictest0-21swapper/307:47:113
9916991615,1cyclictest27679-21apt-get07:47:112
9916991614,1cyclictest0-21swapper/208:02:092
9911991616,0cyclictest0-21swapper/108:27:111
991999150,1cyclictest0-21swapper/307:42:123
9916991512,2cyclictest17239-21users07:22:192
991699150,1cyclictest5269-21apt-get08:07:152
991999140,14cyclictest0-21swapper/307:10:463
991999140,0cyclictest0-21swapper/308:40:213
991999140,0cyclictest0-21swapper/307:55:213
991699140,0cyclictest0-21swapper/208:15:332
9911991414,0cyclictest0-21swapper/107:25:381
991199140,0cyclictest0-21swapper/108:20:201
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional