You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-14 - 19:46

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot5s.osadl.org (updated Sun Jun 14, 2026 12:44:21)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
203499260,25cyclictest31546-21ssh12:15:060
203499260,25cyclictest28245-21diskmemload11:22:510
2044992523,1cyclictest0-21swapper/309:23:473
204499250,24cyclictest28245-21diskmemload10:28:443
2042992523,1cyclictest27840-21rm10:10:512
2042992523,1cyclictest0-21swapper/209:54:482
2042992523,1cyclictest0-21swapper/207:39:492
2042992520,4cyclictest0-21swapper/211:30:562
2038992525,0cyclictest0-21swapper/109:47:511
203899252,2cyclictest0-21swapper/110:57:391
203899250,24cyclictest783-21snmpd11:57:581
203899250,24cyclictest29053-21sh10:42:241
203899250,1cyclictest0-21swapper/112:09:411
2044992421,2cyclictest7514-21ssh10:23:103
204499240,2cyclictest22031-21apt-get07:50:023
204499240,23cyclictest5151-21ssh10:19:533
204499240,23cyclictest28245-21diskmemload12:27:373
204499240,23cyclictest0-21swapper/310:43:503
204499240,23cyclictest0-21swapper/310:10:423
2042992422,1cyclictest14216-21cstates10:59:422
204299240,23cyclictest28245-21diskmemload12:10:012
204299240,23cyclictest28245-21diskmemload10:46:572
204299240,23cyclictest28245-21diskmemload10:15:522
204299240,23cyclictest0-21swapper/212:01:062
204299240,23cyclictest0-21swapper/211:16:312
204299240,1cyclictest0-21swapper/209:04:412
2038992424,0cyclictest0-21swapper/111:41:391
2038992423,1cyclictest0-21swapper/112:39:171
2038992422,1cyclictest27130-21sh10:39:561
203899242,1cyclictest7154-21ssh09:21:091
203899240,24cyclictest0-21swapper/112:14:371
203899240,24cyclictest0-21swapper/111:28:571
203899240,23cyclictest24630-21cpuspeed11:09:411
203899240,0cyclictest0-21swapper/109:14:251
2034992423,1cyclictest30228-21fschecks_time11:44:450
2034992422,1cyclictest0-21swapper/010:49:010
203499240,24cyclictest0-21swapper/011:57:170
203499240,23cyclictest4780-21ssh11:20:000
203499240,23cyclictest0-21swapper/009:21:340
2044992323,0cyclictest28245-21diskmemload11:21:253
2044992323,0cyclictest0-21swapper/311:55:043
2044992323,0cyclictest0-21swapper/310:54:523
2044992321,1cyclictest1065-21ssh11:47:253
2044992321,1cyclictest0-21swapper/312:21:163
2044992320,2cyclictest21642-21ssh11:35:373
2044992320,2cyclictest1373-21idleruntime-cro08:15:003
2044992320,2cyclictest11270-21sh10:55:393
204499230,2cyclictest25049-21sh09:38:573
204499230,23cyclictest0-21swapper/312:06:073
204499230,23cyclictest0-21swapper/311:32:383
204499230,23cyclictest0-21swapper/310:05:013
204499230,23cyclictest0-21swapper/309:33:213
204499230,23cyclictest0-21swapper/309:17:283
204499230,23cyclictest0-21swapper/309:11:593
204499230,22cyclictest652-21ssh11:16:383
204499230,22cyclictest307-21ssh12:16:553
204499230,22cyclictest28245-21diskmemload11:55:013
204499230,22cyclictest25418-21idleruntime-cro12:40:013
204499230,22cyclictest19148-21rm10:03:533
204499230,0cyclictest0-21swapper/312:33:593
204499230,0cyclictest0-21swapper/309:27:113
2042992323,0cyclictest0-21swapper/212:30:202
2042992323,0cyclictest0-21swapper/212:07:172
2042992323,0cyclictest0-21swapper/209:30:042
2042992321,1cyclictest0-21swapper/211:45:012
2042992321,1cyclictest0-21swapper/211:36:202
2042992320,2cyclictest6190-21sh10:21:092
2042992320,2cyclictest29649-21sh09:11:552
2042992320,2cyclictest0-21swapper/209:55:322
204299230,23cyclictest0-21swapper/210:04:122
204299230,23cyclictest0-21swapper/209:41:212
204299230,22cyclictest23461-21awk09:00:002
204299230,22cyclictest21787-21latency_hist10:35:002
204299230,1cyclictest28245-21diskmemload10:29:462
204299230,1cyclictest0-21swapper/209:26:402
204299230,0cyclictest0-21swapper/211:20:142
204299230,0cyclictest0-21swapper/209:38:142
2038992323,0cyclictest0-21swapper/112:22:571
2038992323,0cyclictest0-21swapper/110:53:011
2038992322,1cyclictest16607-21ssh10:30:091
2038992322,1cyclictest0-21swapper/111:48:431
2038992322,1cyclictest0-21swapper/110:23:431
2038992321,1cyclictest0-21swapper/111:15:541
2038992321,1cyclictest0-21swapper/110:09:221
2038992321,1cyclictest0-21swapper/109:55:121
203899231,22cyclictest28245-21diskmemload09:44:011
203899231,21cyclictest0-21swapper/110:26:511
203899231,21cyclictest0-21swapper/109:25:181
203899231,1cyclictest0-21swapper/112:17:531
203899230,23cyclictest0-21swapper/110:03:281
203899230,22cyclictest28778-21sh10:12:191
203899230,22cyclictest28245-21diskmemload12:02:011
203899230,22cyclictest2445-21sh09:17:021
203899230,22cyclictest18670-21munin-run08:50:001
203899230,22cyclictest0-21swapper/111:35:291
203899230,1cyclictest17404-21sh12:33:271
203899230,1cyclictest0-21swapper/111:32:431
203899230,0cyclictest0-21swapper/111:53:151
2034992323,0cyclictest0-21swapper/011:36:130
2034992323,0cyclictest0-21swapper/010:54:010
2034992323,0cyclictest0-21swapper/009:56:480
2034992323,0cyclictest0-21swapper/009:53:050
2034992322,1cyclictest17532-21ssh12:33:470
2034992321,1cyclictest0-21swapper/010:32:390
2034992321,1cyclictest0-21swapper/009:46:180
2034992320,2cyclictest17738-21sh10:01:470
203499231,21cyclictest697-21rm10:15:560
203499230,2cyclictest30513-21sh10:14:420
203499230,2cyclictest28095-21ssh09:40:300
203499230,23cyclictest28245-21diskmemload10:27:120
203499230,23cyclictest0-21swapper/009:11:140
203499230,22cyclictest8064-21sh12:24:410
203499230,22cyclictest21534-21apt-get10:35:020
203499230,22cyclictest16444-21ssh11:30:450
203499230,22cyclictest10906-21ssh10:55:090
203499230,22cyclictest0-21swapper/011:04:440
203499230,0cyclictest28245-21diskmemload11:13:260
203499230,0cyclictest28245-21diskmemload11:09:090
203499230,0cyclictest28245-21diskmemload09:26:130
203499230,0cyclictest0-21swapper/011:26:150
203499230,0cyclictest0-21swapper/010:41:210
2044992222,0cyclictest0-21swapper/312:13:523
2044992222,0cyclictest0-21swapper/310:31:073
2044992222,0cyclictest0-21swapper/309:53:183
2044992222,0cyclictest0-21swapper/309:40:163
2044992221,1cyclictest3384-21apt-get10:49:413
2044992221,0cyclictest29631-21apt-get08:09:413
2044992220,1cyclictest29022-21perf08:05:003
2044992220,1cyclictest0-21swapper/307:40:013
2044992219,2cyclictest26863-21ssh11:40:393
204499220,22cyclictest28245-21diskmemload12:01:383
204499220,22cyclictest17556-21ssh11:02:093
204499220,21cyclictest869-21ssh09:45:193
204499220,21cyclictest28245-21diskmemload10:35:263
204499220,21cyclictest19634-21apt-get07:49:413
204499220,1cyclictest7226-21apt-get08:29:423
204499220,1cyclictest28245-21diskmemload11:06:533
204499220,1cyclictest10732-21ssh11:25:063
204499220,1cyclictest0-21swapper/309:55:033
2042992222,0cyclictest0-21swapper/212:36:172
2042992222,0cyclictest0-21swapper/212:22:382
2042992221,0cyclictest0-21swapper/207:24:412
2042992220,1cyclictest28990-21cron08:05:002
2042992220,1cyclictest21413-21apt-get07:50:012
2042992220,1cyclictest0-21swapper/212:28:042
2042992220,1cyclictest0-21swapper/211:50:272
2042992220,1cyclictest0-21swapper/209:45:102
204299220,2cyclictest0-21swapper/210:51:152
204299220,21cyclictest4833-21apt-get08:24:422
204299220,21cyclictest22428-21apt-get07:54:422
204299220,21cyclictest21049-21idleruntime-cro08:55:002
204299220,21cyclictest0-21swapper/212:17:012
204299220,21cyclictest0-21swapper/211:10:252
204299220,21cyclictest0-21swapper/211:05:342
204299220,21cyclictest0-21swapper/210:08:352
204299220,21cyclictest0-21swapper/209:20:252
204299220,21cyclictest0-21swapper/208:34:412
204299220,1cyclictest2615-21apt-get07:14:412
204299220,1cyclictest11372-21ssh11:26:022
204299220,1cyclictest0-21swapper/210:40:322
204299220,1cyclictest0-21swapper/210:35:242
2038992222,0cyclictest0-21swapper/112:26:331
2038992221,1cyclictest28245-21diskmemload11:10:071
2038992220,1cyclictest26603-21perf08:00:001
2038992220,1cyclictest0-21swapper/109:36:211
203899220,21cyclictest32659-21ssh10:15:161
203899220,21cyclictest27240-21apt-get08:04:431
203899220,21cyclictest0-21swapper/108:24:421
203899220,21cyclictest0-21swapper/107:54:421
203899220,1cyclictest0-21swapper/111:00:301
203899220,0cyclictest0-21swapper/109:33:131
2034992222,0cyclictest7433-21apt-get07:24:410
2034992222,0cyclictest0-21swapper/008:49:420
2034992221,0cyclictest0-21swapper/012:05:350
203499220,2cyclictest22521-21ssh09:35:130
203499220,22cyclictest0-21swapper/012:38:560
203499220,22cyclictest0-21swapper/012:02:240
203499220,22cyclictest0-21swapper/010:07:360
203499220,21cyclictest9898-21rm12:25:160
203499220,21cyclictest5967-21ssh10:20:500
203499220,21cyclictest26561-21diskmemload12:10:280
203499220,21cyclictest17242-21apt-get07:44:420
203499220,21cyclictest16276-21apt08:45:010
203499220,21cyclictest11459-21grep08:35:010
203499220,21cyclictest0-21swapper/011:50:010
203499220,1cyclictest1889-21sh09:16:160
203499220,1cyclictest13873-21perf08:40:010
203499220,1cyclictest0-21swapper/009:32:200
203499220,0cyclictest28245-21diskmemload11:53:450
2044992120,1cyclictest0-21swapper/308:59:413
204499210,20cyclictest0-21swapper/307:34:413
204499210,20cyclictest0-21swapper/307:14:413
204499210,0cyclictest24823-21apt-get07:59:423
204499210,0cyclictest0-21swapper/311:10:273
204499210,0cyclictest0-21swapper/309:09:423
2042992119,1cyclictest16267-21turbostat.cron08:45:012
204299210,21cyclictest0-21swapper/211:47:022
204299210,21cyclictest0-21swapper/209:15:022
204299210,20cyclictest0-21swapper/211:55:302
204299210,20cyclictest0-21swapper/209:09:422
2038992121,0cyclictest0-21swapper/107:39:491
2038992120,1cyclictest0-21swapper/107:29:411
2038992118,2cyclictest6079-21grep07:19:481
203899210,0cyclictest0-21swapper/109:04:411
2034992121,0cyclictest21413-21apt-get07:50:020
2034992120,1cyclictest3786-21apt-get08:20:020
203499210,20cyclictest0-21swapper/009:09:420
203499210,20cyclictest0-21swapper/008:54:390
203499210,1cyclictest0-21swapper/008:10:000
203499210,0cyclictest0-21swapper/008:19:410
2044992020,0cyclictest0-21swapper/308:39:413
204499200,0cyclictest0-21swapper/307:24:413
2042992020,0cyclictest0-21swapper/207:34:412
204299200,0cyclictest18655-21perf08:50:002
204299200,0cyclictest12071-21apt-get08:39:412
204299200,0cyclictest0-21swapper/207:19:412
2038992020,0cyclictest0-21swapper/108:54:401
203899200,20cyclictest0-21swapper/108:39:401
203899200,0cyclictest0-21swapper/107:24:411
2034992020,0cyclictest0-21swapper/007:49:410
2034992020,0cyclictest0-21swapper/007:29:410
2034992020,0cyclictest0-21swapper/007:19:420
2034992019,1cyclictest12276-21apt-get07:34:410
2034992018,1cyclictest8976-21cron08:30:010
203499200,19cyclictest24092-21apt-get09:04:420
2044991918,0cyclictest9825-21apt-get07:29:413
2042991919,0cyclictest0-21swapper/207:29:412
2042991917,1cyclictest3827-21munin-run08:20:002
2038991919,0cyclictest0-21swapper/109:09:421
2038991916,2cyclictest7718-21grep08:29:441
2034991919,0cyclictest32025-21apt-get08:14:410
2034991919,0cyclictest0-21swapper/008:59:400
2034991919,0cyclictest0-21swapper/007:39:410
2044991818,0cyclictest0-21swapper/308:49:413
2044991818,0cyclictest0-21swapper/308:24:423
2044991816,1cyclictest6815-21latency_hist07:20:003
2042991818,0cyclictest0-21swapper/207:44:422
203899185,11cyclictest21275-21tail07:49:501
2038991818,0cyclictest0-21swapper/107:35:001
2038991817,1cyclictest0-21swapper/108:14:421
2038991816,2cyclictest0-21swapper/108:59:431
2038991816,1cyclictest0-21swapper/108:34:411
2038991717,0cyclictest0-21swapper/108:19:411
2038991716,1cyclictest0-21swapper/107:14:421
203899171,14cyclictest0-21swapper/108:44:411
2034991717,0cyclictest0-21swapper/007:14:410
2044991615,0cyclictest2014-21apt-get08:19:413
2038991616,0cyclictest0-21swapper/107:44:421
2044991515,0cyclictest0-21swapper/308:54:393
204299150,1cyclictest0-21swapper/208:15:002
2034991515,0cyclictest0-21swapper/007:59:420
204499140,14cyclictest0-21swapper/309:00:143
204499140,14cyclictest0-21swapper/308:40:533
204499140,14cyclictest0-21swapper/308:30:043
204499140,0cyclictest0-21swapper/307:40:103
2042991414,0cyclictest0-21swapper/207:55:532
204299140,14cyclictest0-21swapper/208:26:372
204299140,14cyclictest0-21swapper/208:05:202
203499140,14cyclictest0-21swapper/008:00:280
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional