You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-07 - 07:12

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackeslot5s.osadl.org (updated Mon Sep 07, 2026 00:44:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
708992522,2cyclictest14739-21ssh00:23:512
70899250,24cyclictest26809-21diskmemload00:15:062
707992523,1cyclictest0-21swapper/123:36:271
70699250,24cyclictest21061-21ssh00:00:430
70699250,24cyclictest0-21swapper/022:49:130
70699250,0cyclictest0-21swapper/023:54:050
709992422,1cyclictest8721-21ssh22:50:393
709992421,2cyclictest18879-21sh23:29:153
70999240,24cyclictest26809-21diskmemload21:28:203
70999240,23cyclictest26809-21diskmemload00:16:173
70999240,1cyclictest26809-21diskmemload23:55:043
708992423,1cyclictest26809-21diskmemload23:16:362
708992423,0cyclictest18841-21ssh22:59:552
70899242,1cyclictest10633-21ssh21:23:252
70899241,22cyclictest783-21snmpd23:00:022
70899240,3cyclictest0-21swapper/222:43:512
707992423,0cyclictest0-21swapper/123:03:451
707992422,1cyclictest0-21swapper/122:11:491
707992421,2cyclictest5511-21cron19:20:001
70799240,24cyclictest26809-21diskmemload22:07:571
70799240,24cyclictest0-21swapper/123:21:151
70799240,23cyclictest8150-21sh22:20:381
70799240,23cyclictest26809-21diskmemload00:37:541
70799240,23cyclictest0-21swapper/100:02:281
70799240,0cyclictest26809-21diskmemload22:51:311
706992423,1cyclictest0-21swapper/022:17:580
706992422,1cyclictest62550irq/127-eno122:56:460
70699240,23cyclictest26809-21diskmemload23:19:550
70699240,23cyclictest26809-21diskmemload22:06:230
70699240,23cyclictest26809-21diskmemload00:36:000
70699240,0cyclictest0-21swapper/023:40:140
70699240,0cyclictest0-21swapper/023:40:140
709992323,0cyclictest26809-21diskmemload00:21:333
709992323,0cyclictest0-21swapper/321:30:213
709992323,0cyclictest0-21swapper/321:14:093
709992321,1cyclictest0-21swapper/300:06:433
709992320,2cyclictest3727-21sh21:16:573
70999230,23cyclictest0-21swapper/323:42:423
70999230,23cyclictest0-21swapper/323:42:423
70999230,23cyclictest0-21swapper/323:16:113
70999230,23cyclictest0-21swapper/322:49:263
70999230,23cyclictest0-21swapper/322:42:363
70999230,23cyclictest0-21swapper/321:51:333
70999230,23cyclictest0-21swapper/321:45:183
70999230,22cyclictest30447-21ssh23:10:163
70999230,22cyclictest23851-21ssh22:34:573
70999230,22cyclictest22261-21ssh00:31:073
70999230,22cyclictest22156-21ssh22:03:133
70999230,22cyclictest19811-21ssh23:00:483
70999230,22cyclictest17595-21dump-pmu-power19:45:013
70999230,22cyclictest16839-21ssh22:27:403
70999230,1cyclictest0-21swapper/322:17:503
70999230,0cyclictest0-21swapper/323:54:573
70999230,0cyclictest0-21swapper/323:06:223
70999230,0cyclictest0-21swapper/322:57:043
70999230,0cyclictest0-21swapper/300:01:443
708992323,0cyclictest0-21swapper/223:36:272
708992323,0cyclictest0-21swapper/222:46:392
708992323,0cyclictest0-21swapper/222:20:582
708992323,0cyclictest0-21swapper/221:57:112
708992320,2cyclictest29145-21rm22:39:422
70899230,23cyclictest1611-21rm23:12:592
70899230,23cyclictest0-21swapper/223:09:132
70899230,23cyclictest0-21swapper/221:26:412
70899230,22cyclictest3496-21apt-get19:16:392
70899230,22cyclictest29009-21rm21:40:222
70899230,22cyclictest2722-21ssh22:15:502
70899230,22cyclictest26809-21diskmemload23:41:082
70899230,22cyclictest26809-21diskmemload23:41:082
70899230,22cyclictest26809-21diskmemload21:15:512
70899230,22cyclictest23646-21rm21:35:402
70899230,22cyclictest15129-21ssh23:26:202
70899230,22cyclictest0-21swapper/222:10:292
70899230,22cyclictest0-21swapper/200:00:582
70899230,1cyclictest30786-21ssh21:12:462
70899230,1cyclictest26809-21diskmemload00:36:182
70899230,0cyclictest26809-21diskmemload23:22:082
70899230,0cyclictest0-21swapper/222:07:572
707992323,0cyclictest26809-21diskmemload21:57:111
707992323,0cyclictest0-21swapper/123:16:361
707992323,0cyclictest0-21swapper/122:59:551
707992323,0cyclictest0-21swapper/122:45:431
707992323,0cyclictest0-21swapper/121:46:521
707992323,0cyclictest0-21swapper/100:34:271
707992321,2cyclictest20177-21ssh23:59:531
707992321,1cyclictest0-21swapper/121:41:281
707992321,1cyclictest0-21swapper/121:13:131
707992320,2cyclictest9513-21head21:21:491
70799230,23cyclictest0-21swapper/121:26:411
70799230,22cyclictest23583-21sh21:35:361
70799230,22cyclictest23372-21ssh23:32:481
70799230,22cyclictest22363-21awk19:55:011
70799230,22cyclictest1648-21sh23:13:011
70799230,22cyclictest10929-21sh00:20:571
70799230,22cyclictest0-21swapper/121:32:361
70799230,22cyclictest0-21swapper/100:10:581
70799230,0cyclictest26809-21diskmemload23:07:201
70799230,0cyclictest0-21swapper/100:15:061
706992323,0cyclictest26809-21diskmemload21:38:010
706992323,0cyclictest26809-21diskmemload00:17:000
706992323,0cyclictest0-21swapper/022:36:290
706992323,0cyclictest0-21swapper/022:11:070
706992323,0cyclictest0-21swapper/021:32:500
706992322,1cyclictest26809-21diskmemload23:30:470
706992322,1cyclictest26809-21diskmemload21:50:270
706992322,1cyclictest0-21swapper/000:22:220
706992321,1cyclictest13132-21apt-get21:26:380
706992321,1cyclictest0-21swapper/023:37:550
706992321,1cyclictest0-21swapper/023:11:120
70699230,23cyclictest0-21swapper/023:49:550
70699230,23cyclictest0-21swapper/021:58:400
70699230,22cyclictest5818-21sendmail21:20:000
70699230,22cyclictest26809-21diskmemload00:30:290
70699230,22cyclictest25088-21ssh23:05:310
70699230,22cyclictest22937-21sh22:33:370
70699230,22cyclictest19993-21munin-run19:50:010
70699230,22cyclictest15333-21ssh23:55:300
70699230,22cyclictest0-21swapper/023:26:570
70699230,22cyclictest0-21swapper/000:06:350
70699230,1cyclictest0-21swapper/000:10:290
70699230,0cyclictest0-21swapper/023:01:120
709992222,0cyclictest0-21swapper/322:37:073
709992222,0cyclictest0-21swapper/322:20:263
709992222,0cyclictest0-21swapper/321:40:113
709992220,1cyclictest0-21swapper/321:20:013
70999220,2cyclictest28917-21sh23:37:593
70999220,22cyclictest0-21swapper/300:25:103
70999220,21cyclictest26809-21diskmemload22:11:033
70999220,21cyclictest0-21swapper/321:35:023
70999220,1cyclictest2383-21latency_hist20:20:003
708992222,0cyclictest0-21swapper/222:01:012
708992220,1cyclictest7563-21apt-get20:31:382
708992220,1cyclictest26809-21diskmemload22:25:272
70899221,21cyclictest2690-21kworker/u8:121:53:032
70899220,22cyclictest0-21swapper/200:30:322
70899220,21cyclictest27569-21apt-get20:06:412
70899220,21cyclictest19739-21ssh23:30:122
70899220,21cyclictest16318-21sh00:25:432
70899220,21cyclictest0-21swapper/200:13:082
70899220,1cyclictest313-21systemd-journal19:55:012
70899220,1cyclictest26809-21diskmemload22:53:362
70899220,1cyclictest26809-21diskmemload00:05:052
70899220,1cyclictest15974-21ssh23:56:292
70899220,1cyclictest0-21swapper/223:51:412
70899220,1cyclictest0-21swapper/223:49:302
707992222,0cyclictest0-21swapper/122:01:011
707992222,0cyclictest0-21swapper/100:25:331
707992221,1cyclictest10014-21apt-get20:36:391
707992220,1cyclictest0-21swapper/123:26:151
707992220,1cyclictest0-21swapper/122:31:401
70799220,22cyclictest0-21swapper/123:46:431
70799220,22cyclictest0-21swapper/123:41:081
70799220,22cyclictest0-21swapper/123:41:081
70799220,21cyclictest8821-21cstates21:51:411
70799220,21cyclictest26809-21diskmemload22:35:181
70799220,21cyclictest26809-21diskmemload21:15:011
70799220,21cyclictest26809-21diskmemload00:05:491
70799220,21cyclictest0-21swapper/122:40:061
70799220,21cyclictest0-21swapper/122:26:251
70799220,21cyclictest0-21swapper/120:06:411
70799220,21cyclictest0-21swapper/119:21:391
70799220,0cyclictest0-21swapper/122:15:501
706992222,0cyclictest0-21swapper/022:40:540
706992220,1cyclictest15162-21latency_hist19:40:000
706992220,1cyclictest0-21swapper/023:22:190
70699220,21cyclictest0-21swapper/022:50:550
70699220,21cyclictest0-21swapper/000:26:490
70699220,1cyclictest8177-21sh22:20:410
70699220,1cyclictest2702-21sh21:46:190
70699220,1cyclictest0-21swapper/022:26:580
709992119,1cyclictest0-21swapper/320:50:013
709992118,2cyclictest10986-21memory23:21:453
70999210,21cyclictest0-21swapper/300:10:013
70999210,20cyclictest12431-21apt-get20:41:393
70999210,1cyclictest0-21swapper/321:05:003
708992120,0cyclictest0-21swapper/220:56:402
70899210,21cyclictest26809-21diskmemload21:45:012
70899210,21cyclictest0-21swapper/222:30:172
70899210,21cyclictest0-21swapper/221:30:442
70899210,0cyclictest0-21swapper/219:21:392
707992121,0cyclictest10662-21apt-get23:51:391
707992121,0cyclictest0-21swapper/120:56:401
70799210,20cyclictest15218-21apt-get20:46:391
70799210,20cyclictest0-21swapper/119:41:391
70799210,0cyclictest0-21swapper/121:06:391
706992119,1cyclictest24806-21awk20:00:010
70699210,21cyclictest0-21swapper/022:01:530
70699210,21cyclictest0-21swapper/020:46:390
70699210,0cyclictest20009-21apt-get20:56:390
70699210,0cyclictest0-21swapper/021:40:130
709992020,0cyclictest0-21swapper/320:11:403
709992020,0cyclictest0-21swapper/319:30:003
709992020,0cyclictest0-21swapper/319:11:403
709992019,0cyclictest0-21swapper/319:56:393
70999200,0cyclictest0-21swapper/320:51:393
70899200,20cyclictest0-21swapper/219:36:402
70899200,0cyclictest15575-21apt-get19:41:392
707992020,0cyclictest0-21swapper/120:31:381
706992020,0cyclictest0-21swapper/020:41:390
706992020,0cyclictest0-21swapper/020:26:410
706992020,0cyclictest0-21swapper/020:01:400
706992020,0cyclictest0-21swapper/019:41:390
706992020,0cyclictest0-21swapper/019:26:370
706992018,1cyclictest26801-21cron21:10:000
706992018,1cyclictest19624-21latency_hist20:55:000
708991919,0cyclictest0-21swapper/220:36:402
708991917,1cyclictest12776-21perf19:35:002
708991916,2cyclictest2362-21tr20:20:002
707991918,1cyclictest0-21swapper/119:46:411
707991917,1cyclictest12790-21awk19:35:001
707991916,2cyclictest24791-21wc20:00:011
707991916,2cyclictest2364-21sh20:20:001
706991919,0cyclictest0-21swapper/021:01:400
706991916,2cyclictest2391-21munin-run20:20:000
709991818,0cyclictest0-21swapper/320:36:403
709991818,0cyclictest0-21swapper/319:51:383
709991816,1cyclictest27156-21cron20:05:003
708991818,0cyclictest0-21swapper/219:46:412
708991817,1cyclictest25174-21apt-get20:01:402
708991817,1cyclictest24785-21basename20:00:012
708991817,0cyclictest5167-21apt-get20:26:412
706991818,0cyclictest0-21swapper/020:10:000
709991717,0cyclictest0-21swapper/319:16:393
708991717,0cyclictest0-21swapper/221:06:402
707991717,0cyclictest0-21swapper/120:26:411
707991717,0cyclictest0-21swapper/120:01:401
707991716,0cyclictest0-21swapper/119:36:401
70699170,0cyclictest0-21swapper/020:11:400
70999163,12cyclictest29672-21munin-node19:20:243
709991616,0cyclictest24818-21apt-get21:06:403
709991616,0cyclictest0-21swapper/320:06:413
709991614,1cyclictest9640-21perf20:35:013
70899168,7cyclictest15049-21packagekitd20:49:062
708991615,1cyclictest29963-21apt-get20:11:402
708991614,1cyclictest0-21swapper/220:55:002
707991614,1cyclictest0-21swapper/120:55:001
70799160,1cyclictest0-21swapper/121:01:411
706991614,1cyclictest0-21swapper/020:40:010
70699160,1cyclictest12828-21latency_hist19:35:000
70699160,1cyclictest0-21swapper/020:35:010
709991513,1cyclictest6886-21users20:26:513
708991515,0cyclictest0-21swapper/220:41:392
707991515,0cyclictest0-21swapper/120:41:391
707991515,0cyclictest0-21swapper/120:11:401
706991515,0cyclictest0-21swapper/019:11:400
709991414,0cyclictest0-21swapper/319:46:173
709991414,0cyclictest0-21swapper/319:36:233
70999140,14cyclictest0-21swapper/320:56:253
70999140,14cyclictest0-21swapper/320:20:143
70999140,14cyclictest0-21swapper/319:31:253
708991414,0cyclictest0-21swapper/219:25:052
70899140,14cyclictest0-21swapper/221:00:562
70899140,14cyclictest0-21swapper/220:20:452
70899140,14cyclictest0-21swapper/219:11:152
707991414,0cyclictest0-21swapper/119:25:051
70799140,14cyclictest0-21swapper/120:20:451
70799140,0cyclictest0-21swapper/119:11:281
706991414,0cyclictest0-21swapper/019:20:330
70699140,14cyclictest0-21swapper/019:50:200
70699140,14cyclictest0-21swapper/019:15:110
70699140,0cyclictest0-21swapper/020:21:290
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional