You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-23 - 09:45

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot5s.osadl.org (updated Thu Apr 23, 2026 00:44:21)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
17305992525,0cyclictest0-21swapper/222:19:072
1730599250,24cyclictest10925-21diskmemload23:43:112
1730599250,1cyclictest10925-21diskmemload21:17:412
17301992523,1cyclictest0-21swapper/121:32:421
1730199250,24cyclictest10925-21diskmemload21:13:191
1730199250,24cyclictest0-21swapper/122:39:151
1730199250,1cyclictest10925-21diskmemload21:49:561
1729599253,1cyclictest10925-21diskmemload23:54:090
17295992523,1cyclictest0-21swapper/023:27:150
1729599250,24cyclictest0-21swapper/022:10:060
1729599250,24cyclictest0-21swapper/000:20:230
17306992423,1cyclictest10925-21diskmemload22:26:083
17306992423,0cyclictest29667-21ssh21:27:083
17306992422,1cyclictest21189-21ssh22:53:483
1730699240,24cyclictest10925-21diskmemload23:45:023
1730699240,24cyclictest0-21swapper/322:19:433
1730699240,23cyclictest10925-21diskmemload22:49:223
17305992421,2cyclictest0-21swapper/222:37:022
1730599240,23cyclictest29938-21latency_hist22:00:012
1730599240,23cyclictest0-21swapper/222:49:222
1730599240,0cyclictest0-21swapper/223:17:292
17301992421,2cyclictest765-21ssh22:02:031
1730199241,22cyclictest10935-21latency_hist21:10:011
1730199240,24cyclictest0-21swapper/123:22:481
1730199240,23cyclictest28285-21munin-run22:30:001
1730199240,23cyclictest0-21swapper/123:10:181
17295992424,0cyclictest0-21swapper/023:16:050
17295992423,1cyclictest10925-21diskmemload23:34:280
17295992422,1cyclictest0-21swapper/023:24:150
17295992422,1cyclictest0-21swapper/022:44:460
17295992422,1cyclictest0-21swapper/022:06:060
17295992421,2cyclictest783-21snmpd00:33:020
1729599240,24cyclictest0-21swapper/022:51:130
1729599240,24cyclictest0-21swapper/021:22:180
1729599240,23cyclictest10925-21diskmemload21:57:320
1729599240,23cyclictest0-21swapper/023:58:550
1729599240,23cyclictest0-21swapper/022:26:520
1729599240,1cyclictest62550irq/127-eno123:37:450
1729599240,0cyclictest0-21swapper/020:45:170
17306992323,0cyclictest10925-21diskmemload00:25:373
17306992323,0cyclictest0-21swapper/323:04:403
17306992323,0cyclictest0-21swapper/322:08:583
17306992323,0cyclictest0-21swapper/321:49:553
17306992323,0cyclictest0-21swapper/321:43:243
17306992323,0cyclictest0-21swapper/321:14:253
17306992322,0cyclictest0-21swapper/323:52:563
17306992321,1cyclictest0-21swapper/323:36:593
17306992320,2cyclictest25897-21expr23:30:203
17306992320,2cyclictest22311-21ssh22:55:143
1730699230,2cyclictest22640-21ssh23:58:253
1730699230,2cyclictest19629-21ls19:15:003
1730699230,23cyclictest0-21swapper/323:25:463
1730699230,23cyclictest0-21swapper/322:10:023
1730699230,23cyclictest0-21swapper/321:22:273
1730699230,23cyclictest0-21swapper/321:16:353
1730699230,22cyclictest6808-21ssh22:40:113
1730699230,22cyclictest3435-21plymouth00:10:263
1730699230,22cyclictest31783-21ssh22:32:343
1730699230,22cyclictest27529-21apt-get00:35:193
1730699230,22cyclictest10925-21diskmemload22:37:223
1730699230,22cyclictest0-21swapper/323:41:563
1730699230,1cyclictest14062-21ssh23:18:203
1730699230,1cyclictest10925-21diskmemload00:24:573
1730699230,0cyclictest10925-21diskmemload23:11:413
1730699230,0cyclictest0-21swapper/323:21:113
1730699230,0cyclictest0-21swapper/322:03:013
17305992323,0cyclictest10925-21diskmemload23:04:402
17305992323,0cyclictest0-21swapper/221:49:552
17305992323,0cyclictest0-21swapper/221:43:242
17305992323,0cyclictest0-21swapper/221:27:082
17305992322,0cyclictest0-21swapper/200:31:012
17305992320,2cyclictest23747-21ssh21:53:242
17305992319,3cyclictest0-21swapper/223:21:402
1730599230,23cyclictest0-21swapper/223:45:022
1730599230,23cyclictest0-21swapper/222:25:102
1730599230,22cyclictest8065-21ssh21:38:012
1730599230,22cyclictest7492-21grep22:40:202
1730599230,22cyclictest10925-21diskmemload22:23:532
1730599230,22cyclictest10713-21ssh00:18:262
1730599230,22cyclictest0-21swapper/200:35:192
1730599230,0cyclictest10925-21diskmemload21:11:012
1730599230,0cyclictest0-21swapper/222:08:012
1730599230,0cyclictest0-21swapper/222:03:012
17301992323,0cyclictest10925-21diskmemload22:31:341
17301992323,0cyclictest10925-21diskmemload21:41:041
17301992323,0cyclictest0-21swapper/123:46:041
17301992323,0cyclictest0-21swapper/122:49:031
17301992323,0cyclictest0-21swapper/122:16:091
17301992323,0cyclictest0-21swapper/121:39:221
17301992323,0cyclictest0-21swapper/121:22:311
17301992323,0cyclictest0-21swapper/100:35:191
17301992321,1cyclictest0-21swapper/100:20:201
1730199230,2cyclictest21356-21turbostat.cron20:25:011
1730199230,23cyclictest0-21swapper/123:42:411
1730199230,22cyclictest22409-21apt-get00:30:191
1730199230,22cyclictest20974-21ssh22:21:331
1730199230,22cyclictest0-21swapper/122:08:381
1730199230,0cyclictest0-21swapper/123:18:571
1730199230,0cyclictest0-21swapper/122:56:581
1730199230,0cyclictest0-21swapper/100:29:251
17295992323,0cyclictest0-21swapper/022:22:190
17295992323,0cyclictest0-21swapper/022:03:410
17295992322,1cyclictest62550irq/127-eno121:50:520
17295992321,1cyclictest31043-21ssh00:38:080
17295992321,1cyclictest0-21swapper/022:15:420
17295992321,1cyclictest0-21swapper/020:15:180
17295992321,1cyclictest0-21swapper/000:02:200
1729599230,2cyclictest6924-21sh21:36:100
1729599230,23cyclictest10925-21diskmemload21:46:510
1729599230,22cyclictest21328-21dump-pmu-power21:20:010
1729599230,22cyclictest0-21swapper/023:10:240
1729599230,22cyclictest0-21swapper/023:04:370
1729599230,1cyclictest14531-21ssh22:46:290
1729599230,0cyclictest10925-21diskmemload22:36:380
17306992222,0cyclictest0-21swapper/323:08:363
17306992221,1cyclictest29239-21apt-get20:40:183
17306992221,1cyclictest0-21swapper/321:54:363
17306992221,1cyclictest0-21swapper/321:30:133
17306992220,1cyclictest3751-21munin-run20:55:003
17306992220,1cyclictest1323-21turbostat.cron20:50:003
17306992220,1cyclictest0-21swapper/321:55:243
17306992220,1cyclictest0-21swapper/321:38:063
17306992220,1cyclictest0-21swapper/321:05:013
1730699220,2cyclictest24490-21ssh00:30:463
1730699220,21cyclictest0-21swapper/320:30:023
1730699220,21cyclictest0-21swapper/319:55:003
1730699220,1cyclictest9383-21ssh00:16:083
1730699220,1cyclictest18617-21cpuspeed_turbos22:20:203
1730699220,1cyclictest0-21swapper/300:09:313
17305992222,0cyclictest0-21swapper/200:00:032
17305992221,1cyclictest31378-21ssh00:05:522
17305992221,1cyclictest25587-21ssh21:23:452
17305992221,1cyclictest10925-21diskmemload21:31:232
17305992221,0cyclictest0-21swapper/220:40:182
17305992220,1cyclictest14255-21fschecks_count23:50:202
17305992220,1cyclictest0-21swapper/221:05:012
17305992220,1cyclictest0-21swapper/220:50:002
1730599220,21cyclictest796-21ssh23:36:182
1730599220,21cyclictest3168-21ssh23:07:232
1730599220,21cyclictest18362-21awk22:50:252
1730599220,21cyclictest10925-21diskmemload22:30:212
1730599220,21cyclictest0-21swapper/219:20:182
1730599220,21cyclictest0-21swapper/200:10:272
1730599220,1cyclictest7666-21ssh23:11:242
1730599220,1cyclictest19625-21awk19:15:002
1730599220,1cyclictest0-21swapper/223:56:272
1730599220,0cyclictest0-21swapper/222:56:542
1730599220,0cyclictest0-21swapper/222:10:022
17301992222,0cyclictest0-21swapper/121:55:081
17301992221,0cyclictest0-21swapper/123:06:531
17301992220,2cyclictest31293-21ssh00:05:451
17301992220,1cyclictest28595-21ntp_states23:00:241
17301992220,1cyclictest22088-21ssh21:50:401
17301992220,1cyclictest18968-21/usr/sbin/munin23:55:301
17301992220,1cyclictest0-21swapper/100:00:161
1730199220,2cyclictest4487-21idleruntime-cro19:50:001
1730199220,21cyclictest9301-21perf20:00:001
1730199220,21cyclictest16483-21ssh21:15:091
1730199220,21cyclictest10925-21diskmemload23:35:521
1730199220,21cyclictest0-21swapper/123:50:011
1730199220,21cyclictest0-21swapper/122:40:311
1730199220,21cyclictest0-21swapper/121:30:001
1730199220,1cyclictest606-21dbus-daemon20:50:001
1730199220,1cyclictest11534-21ssh22:12:521
1730199220,1cyclictest0-21swapper/120:20:011
1730199220,0cyclictest0-21swapper/100:15:111
17295992222,0cyclictest0-21swapper/021:11:510
17295992221,1cyclictest10925-21diskmemload23:40:340
17295992220,1cyclictest0-21swapper/021:40:230
1729599220,22cyclictest1405-21ssh00:09:490
1729599220,21cyclictest32388-21apt-get19:40:180
1729599220,21cyclictest28681-21ssh21:25:330
1729599220,21cyclictest0-21swapper/023:45:380
1729599220,21cyclictest0-21swapper/022:30:320
1729599220,21cyclictest0-21swapper/019:35:180
1729599220,21cyclictest0-21swapper/000:25:260
1729599220,21cyclictest0-21swapper/000:10:140
1729599220,1cyclictest0-21swapper/022:55:200
17306992120,1cyclictest9580-21apt-get20:00:183
17306992120,0cyclictest2371-21apt-get19:45:193
17306992119,1cyclictest9318-21awk20:00:003
1730699210,21cyclictest0-21swapper/319:20:183
1730699210,1cyclictest0-21swapper/320:20:183
17305992120,1cyclictest25645-21ssh23:30:122
17305992120,0cyclictest0-21swapper/219:40:182
17305992119,1cyclictest9308-21munin-run20:00:002
17305992119,1cyclictest19188-21apt-get20:20:172
1730599210,0cyclictest24371-21apt-get20:30:022
17301992121,0cyclictest0-21swapper/120:35:181
17301992120,0cyclictest0-21swapper/119:10:171
17301992119,1cyclictest4018-21apt-get20:55:191
1730199210,21cyclictest0-21swapper/100:10:271
1730199210,0cyclictest19043-21ssh22:50:281
1730199210,0cyclictest0-21swapper/123:30:531
17295992118,2cyclictest606-21dbus-daemon21:10:010
1729599210,21cyclictest0-21swapper/020:25:180
1729599210,20cyclictest0-21swapper/020:40:170
1729599210,0cyclictest0-21swapper/000:15:190
17306992017,2cyclictest27289-21latency_hist19:30:013
1730699200,0cyclictest0-21swapper/320:15:183
17305992020,0cyclictest0-21swapper/220:55:002
17305992020,0cyclictest0-21swapper/220:00:182
17305992020,0cyclictest0-21swapper/219:45:192
17305992018,1cyclictest18920-21sendmail-msp20:20:012
17301992019,0cyclictest21636-21apt-get20:25:181
17301992018,1cyclictest29239-21apt-get20:40:171
1730199200,20cyclictest0-21swapper/119:35:181
1730199200,0cyclictest0-21swapper/120:30:191
17295992020,0cyclictest0-21swapper/021:00:180
17295992020,0cyclictest0-21swapper/020:00:180
17295992020,0cyclictest0-21swapper/019:25:190
17295992019,1cyclictest17520-21apt-get19:10:170
17295992019,0cyclictest0-21swapper/020:25:010
17295992018,1cyclictest4483-21perf19:50:000
17306991919,0cyclictest0-21swapper/319:40:183
17306991917,1cyclictest14072-21cron20:10:003
17305991917,1cyclictest313-21systemd-journal20:10:002
17301991917,1cyclictest0-21swapper/120:55:001
17295991919,0cyclictest0-21swapper/019:30:170
17295991917,1cyclictest0-21swapper/019:25:010
17306991818,0cyclictest0-21swapper/320:25:183
17306991817,1cyclictest19914-21apt-get19:15:173
17306991816,1cyclictest32121-21munin-run19:40:013
17305991818,0cyclictest0-21swapper/220:25:182
17301991818,0cyclictest0-21swapper/120:05:181
17301991818,0cyclictest0-21swapper/119:50:191
17301991818,0cyclictest0-21swapper/119:40:181
17301991816,1cyclictest8567-21munin-run21:05:011
17295991816,1cyclictest9311-21awk20:00:000
17306991717,0cyclictest0-21swapper/321:05:183
17305991717,0cyclictest8831-21apt-get21:05:182
17305991717,0cyclictest0-21swapper/219:15:172
17301991717,0cyclictest25178-21apt-get19:25:181
17301991717,0cyclictest0-21swapper/120:10:181
17301991716,0cyclictest0-21swapper/119:15:171
17295991717,0cyclictest0-21swapper/020:05:180
17306991616,0cyclictest0-21swapper/320:55:193
17305991616,0cyclictest0-21swapper/220:55:192
17305991616,0cyclictest0-21swapper/219:40:012
17305991616,0cyclictest0-21swapper/219:25:182
17295991616,0cyclictest0-21swapper/020:55:190
1730699150,1cyclictest0-21swapper/320:35:193
17301991515,0cyclictest0-21swapper/120:00:181
17301991513,1cyclictest0-21swapper/119:20:021
17295991515,0cyclictest26826-21apt-get20:35:180
17295991515,0cyclictest0-21swapper/020:30:020
17306991414,0cyclictest0-21swapper/320:10:283
1730699140,0cyclictest0-21swapper/319:30:593
17305991414,0cyclictest0-21swapper/220:35:182
17305991414,0cyclictest0-21swapper/220:10:292
1730599140,0cyclictest0-21swapper/219:31:392
17295991414,0cyclictest0-21swapper/020:50:490
17295991412,1cyclictest4770-21apt-get19:50:190
1729599140,14cyclictest0-21swapper/020:11:100
1729599140,14cyclictest0-21swapper/019:15:420
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional