You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-06 - 15:34

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #7, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack7slot3s.osadl.org (updated Sun Sep 06, 2026 12:43:37)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3208922670,2sleep332076-21munin-run07:10:163
613121050,14sleep27950irq/56-dwc_otg_09:42:512
212982910,5sleep13230899cyclictest09:21:241
205092870,2sleep00-21swapper/012:36:290
309792860,5sleep33231099cyclictest12:10:353
263772800,2sleep20-21swapper/210:06:552
248922800,1sleep00-21swapper/009:25:420
323352760,8sleep2301ktimersoftd/211:32:582
323352760,8sleep2301ktimersoftd/211:32:582
189322740,2sleep30-21swapper/309:19:413
3230899732,8cyclictest0-21swapper/111:10:281
3230899728,48cyclictest7850irq/56-dwc_otg_09:35:371
3230799727,31cyclictest0-21swapper/008:15:300
3230799727,31cyclictest0-21swapper/008:15:300
3230899707,23cyclictest0-21swapper/112:30:231
3230899707,23cyclictest0-21swapper/112:30:231
3230899695,45cyclictest7950irq/56-dwc_otg_09:30:171
60682680,4sleep33231099cyclictest12:20:173
60682680,4sleep33231099cyclictest12:20:173
3230899681,54cyclictest23471-21ssh11:21:501
269962680,33sleep13230899cyclictest11:25:441
3230799661,25cyclictest1987-21cut07:15:350
3230899658,42cyclictest7750irq/56-dwc_otg09:15:451
3230799641,11cyclictest25699-21ssh11:25:280
3230899632,10cyclictest10759-21diskmemload11:55:291
32308996318,31cyclictest2658-21if_wlan012:15:351
32308996318,31cyclictest2658-21if_wlan012:15:351
3230899631,5cyclictest4100-21ssh10:59:211
3230799631,15cyclictest0-21swapper/012:00:370
3230899628,32cyclictest7750irq/56-dwc_otg07:10:431
3230899626,43cyclictest0-21swapper/110:10:431
3230899624,47cyclictest7850irq/56-dwc_otg_11:07:551
3230799622,19cyclictest11654-21grep12:25:450
3230799621,19cyclictest0-21swapper/010:15:300
3230899617,43cyclictest0-21swapper/109:34:521
3230899617,42cyclictest7750irq/56-dwc_otg09:58:131
3230899617,42cyclictest7750irq/56-dwc_otg09:58:131
3230899617,35cyclictest7750irq/56-dwc_otg10:35:311
3230899613,4cyclictest7850irq/56-dwc_otg_09:10:301
3230899612,4cyclictest0-21swapper/111:43:511
3230899611,44cyclictest0-21swapper/110:17:501
3230799616,22cyclictest0-21swapper/007:45:300
32307996137,8cyclictest7750irq/56-dwc_otg12:25:160
3230899601,7cyclictest4347-21grep08:50:381
3230799601,5cyclictest3449-21sh09:40:170
3230799601,34cyclictest0-21swapper/010:15:160
202312600,2sleep10-21swapper/110:00:211
3230899597,28cyclictest0-21swapper/110:32:511
3230899595,4cyclictest7850irq/56-dwc_otg_10:50:291
3230899595,4cyclictest7850irq/56-dwc_otg_10:50:291
3230899594,4cyclictest7750irq/56-dwc_otg12:25:331
3230899592,12cyclictest0-21swapper/107:30:261
3230899592,12cyclictest0-21swapper/107:30:261
3230899591,6cyclictest7886-21/usr/sbin/munin09:45:281
32307995938,9cyclictest26592-21kworker/0:108:25:350
3230899581,47cyclictest7690-21ssh10:24:251
3230899581,47cyclictest7690-21ssh10:24:251
3231099573,5cyclictest0-21swapper/311:25:293
3230899573,6cyclictest13694-21taskset09:51:241
3230899573,4cyclictest7750irq/56-dwc_otg12:35:331
3230899573,4cyclictest0-21swapper/112:11:561
3230899572,3cyclictest0-21swapper/111:53:091
3230899571,5cyclictest7850irq/56-dwc_otg_08:59:191
3230899571,12cyclictest2045150ssh11:19:021
3230799573,34cyclictest0-21swapper/007:35:280
3230799571,40cyclictest10762-21latency_hist09:10:160
3230899563,4cyclictest7750irq/56-dwc_otg11:30:271
3230899563,4cyclictest7750irq/56-dwc_otg11:30:271
3230899563,48cyclictest12297-21sh07:45:161
3230899561,9cyclictest0-21swapper/109:44:031
3230899561,5cyclictest7750irq/56-dwc_otg10:30:121
3230899561,4cyclictest22892-21ssh12:00:391
3230799569,29cyclictest0-21swapper/012:15:440
3230799569,29cyclictest0-21swapper/012:15:440
3230799569,25cyclictest13255-21grep09:50:450
3230799568,28cyclictest0-21swapper/010:05:420
32309995515,4cyclictest7950irq/56-dwc_otg_10:40:302
3230899552,3cyclictest0-21swapper/110:40:351
3230899551,6cyclictest2328-21ssh11:35:411
3230899551,45cyclictest0-21swapper/108:04:341
3230799554,39cyclictest101ktimersoftd/009:40:360
3230799552,4cyclictest7750irq/56-dwc_otg09:15:290
32307995518,25cyclictest7950irq/56-dwc_otg_11:20:230
3230899542,4cyclictest0-21swapper/111:04:321
3230899542,39cyclictest7850irq/56-dwc_otg_12:25:171
3230899541,44cyclictest0-21swapper/110:08:331
3230899541,40cyclictest28021-21ssh10:48:521
3230899541,40cyclictest26370-21dhclient-script08:20:471
3230899541,39cyclictest0-21swapper/111:47:451
3230899541,39cyclictest0-21swapper/111:47:451
3230799541,5cyclictest3441-21munin-run08:50:160
3230799541,5cyclictest3441-21munin-run08:50:160
3230799541,35cyclictest16626-21ssh09:55:350
3230799541,35cyclictest16626-21ssh09:55:350
32307995411,25cyclictest12976-21fschecks_time10:30:340
3230899533,5cyclictest7750irq/56-dwc_otg08:15:021
3230899533,40cyclictest7750irq/56-dwc_otg12:07:141
3230899532,42cyclictest0-21swapper/107:37:231
3230899531,40cyclictest0-21swapper/108:09:591
32307995324,6cyclictest18456-21sh12:35:170
32307995324,6cyclictest18456-21sh12:35:170
3230799531,31cyclictest19813-21cut08:05:300
3230899523,6cyclictest0-21swapper/107:15:311
3230899523,5cyclictest0-21swapper/107:50:271
3230899522,11cyclictest7750irq/56-dwc_otg07:55:291
3230899521,7cyclictest27010-21cut08:25:301
3230899521,6cyclictest3952-21if_wlan007:20:361
3230899521,6cyclictest31576-21/usr/sbin/munin08:35:451
3230899521,5cyclictest0-21swapper/108:31:441
3230799527,33cyclictest1735-21ls08:45:170
32307995236,5cyclictest7950irq/56-dwc_otg_09:00:160
32307995227,5cyclictest11458-21cut09:10:360
3230799522,31cyclictest31748-21sed12:10:440
3230799521,26cyclictest18013-21sed10:35:450
3230899516,42cyclictest3443-21runrttasks08:50:161
3230899516,42cyclictest3443-21runrttasks08:50:161
3230899516,10cyclictest7850irq/56-dwc_otg_07:45:281
3230899511,5cyclictest8493-21tail09:00:441
32307995127,5cyclictest8169-21ssh09:45:340
3230799511,33cyclictest13-21rcuc/011:55:390
32307995113,22cyclictest28505-21sh09:30:380
3230799511,29cyclictest8953-21idleruntime-cro09:05:160
3230799511,29cyclictest28411-21ssh10:49:350
3230799511,27cyclictest0-21swapper/007:40:450
3230799511,26cyclictest0-21swapper/011:30:370
3230799511,26cyclictest0-21swapper/011:30:370
3230899502,5cyclictest24279-21timerandwakeup08:15:421
3230899502,5cyclictest24279-21timerandwakeup08:15:421
3230799506,9cyclictest7750irq/56-dwc_otg10:50:280
3230799506,9cyclictest7750irq/56-dwc_otg10:50:280
32307995036,6cyclictest7850irq/56-dwc_otg_11:50:370
3230799503,31cyclictest2729-21grep11:35:450
32307995026,8cyclictest21231-21rm11:20:170
3230799502,27cyclictest0-21swapper/007:30:350
3230799502,27cyclictest0-21swapper/007:30:350
3230799502,23cyclictest0-21swapper/009:20:440
32307995014,22cyclictest6585-21taskset11:01:210
3230999493,8cyclictest0-21swapper/210:15:272
3230899491,4cyclictest6889-21idleruntime-cro07:30:171
3230799494,26cyclictest1180-21runrttasks08:20:370
32307994926,11cyclictest7950irq/56-dwc_otg_12:05:450
32307994917,16cyclictest0-21swapper/011:10:020
3230899481,5cyclictest595-21sed08:40:371
32307994833,4cyclictest7850irq/56-dwc_otg_11:10:370
32307994817,18cyclictest10759-21diskmemload10:20:340
32307994817,18cyclictest10759-21diskmemload10:20:340
3230799481,26cyclictest15914-21munin-run07:55:160
318462483,13sleep00-21swapper/007:07:470
3231099474,5cyclictest37-21rcuc/309:30:303
3230799472,26cyclictest0-21swapper/010:55:330
3231099467,24cyclictest0-21swapper/307:55:303
3230799462,24cyclictest0-21swapper/010:40:350
32307994617,21cyclictest7850irq/56-dwc_otg_11:40:220
3230799461,25cyclictest18617-21grep08:00:380
3231099457,25cyclictest0-21swapper/309:00:223
3230999457,24cyclictest0-21swapper/208:25:302
3230999456,12cyclictest0-21swapper/209:15:282
3230899451,7cyclictest9223-21aten_rbpower_cu09:05:311
32307994526,5cyclictest7950irq/56-dwc_otg_08:55:160
3230799452,29cyclictest0-21swapper/007:28:580
32307994516,17cyclictest9071-21ssh10:25:350
3230799451,24cyclictest21011-21ssh10:00:390
3230799451,15cyclictest1-21systemd07:23:230
32307994511,19cyclictest0-21swapper/011:45:290
32307994511,19cyclictest0-21swapper/011:45:290
3231099447,22cyclictest0-21swapper/311:40:223
3231099441,3cyclictest0-21swapper/308:30:293
3230999447,24cyclictest0-21swapper/212:20:302
3230999442,4cyclictest0-21swapper/211:35:302
32309994411,25cyclictest0-21swapper/209:45:222
32307994316,20cyclictest0-21swapper/008:38:000
32307994312,17cyclictest7850irq/56-dwc_otg_08:30:330
3230999427,23cyclictest0-21swapper/211:40:312
3230999424,6cyclictest0-21swapper/207:35:302
32307994217,19cyclictest0-21swapper/007:12:180
3231099417,24cyclictest0-21swapper/308:45:303
3231099417,24cyclictest0-21swapper/308:45:303
32310994127,6cyclictest4958-21unixbench_singl09:40:453
3231099412,29cyclictest0-21swapper/307:18:163
3230999418,25cyclictest0-21swapper/207:45:302
3230999417,24cyclictest0-21swapper/208:20:292
32310994018,5cyclictest24926-21sh08:20:173
32310994018,5cyclictest24926-21sh08:20:173
3230999401,11cyclictest0-21swapper/207:10:272
32309993910,15cyclictest8569-21ssh10:25:302
3231099386,25cyclictest0-21swapper/307:35:303
3231099382,3cyclictest0-21swapper/310:05:293
32310993815,6cyclictest16203-21systemd-journal09:40:163
3230999386,5cyclictest7950irq/56-dwc_otg_10:35:172
32309993818,5cyclictest2639450wget12:05:302
32309993810,4cyclictest0-21swapper/210:20:342
32309993810,4cyclictest0-21swapper/210:20:342
32307993815,17cyclictest0-21swapper/007:56:530
317912381,4sleep331801-21ssh11:31:593
317912381,4sleep331801-21ssh11:31:593
3231099376,19cyclictest4680-21cut10:20:333
3231099376,19cyclictest4680-21cut10:20:333
3230999373,21cyclictest15094-21ssh09:53:592
32309993719,5cyclictest23621-21fschecks_count08:15:332
32309993719,5cyclictest23621-21fschecks_count08:15:332
3230999371,5cyclictest2177-21sh12:15:272
3230999371,5cyclictest2177-21sh12:15:272
3230999371,3cyclictest7750irq/56-dwc_otg10:50:292
3230999371,3cyclictest7750irq/56-dwc_otg10:50:292
3230999371,18cyclictest7950irq/56-dwc_otg_08:40:182
124742370,2sleep20-21swapper/211:09:352
3231099366,5cyclictest7750irq/56-dwc_otg11:40:163
32310993627,3cyclictest7950irq/56-dwc_otg_09:53:183
32310993625,4cyclictest62612chrt11:00:463
3230999366,4cyclictest7750irq/56-dwc_otg11:05:162
32309993630,4cyclictest21273-21ls10:00:432
32309993629,5cyclictest19950-21fschecks_time09:20:342
3230999362,5cyclictest7950irq/56-dwc_otg_09:35:282
32309993615,4cyclictest13376-21cpu11:10:312
32309993610,11cyclictest26785-21grep11:25:432
3230799361,25cyclictest0-21swapper/008:10:290
305022367,18sleep130605-21aten_rbpower_vo07:05:301
288202360,6sleep33231099cyclictest10:10:343
206992360,5sleep23230999cyclictest11:19:292
3231099356,6cyclictest7950irq/56-dwc_otg_12:35:483
3231099356,20cyclictest26368-21ssh12:05:293
3231099354,19cyclictest4750irq/17-3f00b88010:55:333
3231099353,3cyclictest7850irq/56-dwc_otg_10:47:003
32310993510,4cyclictest7992-21aten_rbpower_po09:45:313
3230999359,11cyclictest7850irq/56-dwc_otg_09:10:172
3230999358,13cyclictest7950irq/56-dwc_otg_10:58:002
3230999357,25cyclictest0-21swapper/207:25:302
3230999357,24cyclictest0-21swapper/207:20:302
3230999355,4cyclictest7950irq/56-dwc_otg_11:47:372
3230999355,4cyclictest7950irq/56-dwc_otg_11:47:372
3230999352,18cyclictest8830-21latency_hist07:35:172
3230999352,18cyclictest8830-21latency_hist07:35:172
3230999351,4cyclictest7950irq/56-dwc_otg_12:30:282
3230999351,4cyclictest7950irq/56-dwc_otg_12:30:282
257182350,3sleep232301-21cyclictest09:26:572
212742350,1sleep30-21swapper/309:21:223
127482350,8sleep2301ktimersoftd/212:27:332
3231099348,5cyclictest7750irq/56-dwc_otg11:20:173
3231099348,15cyclictest0-21swapper/311:20:313
3231099346,6cyclictest7750irq/56-dwc_otg10:35:163
3231099345,16cyclictest28571-21http08:30:163
32310993423,8cyclictest9097-21ssh11:05:303
3231099342,24cyclictest10125-21ssh12:25:163
32310993417,4cyclictest15898-21unixbench_multi12:30:453
32310993417,4cyclictest15898-21unixbench_multi12:30:453
32310993413,5cyclictest1180-21runrttasks10:36:493
32310993411,8cyclictest16203-21systemd-journal09:10:163
32310993411,5cyclictest0-21swapper/310:15:393
32310993411,11cyclictest0-21swapper/309:10:323
3230999341,23cyclictest28551-21ssh09:30:392
3230999341,23cyclictest17066-21timerandwakeup07:55:432
3230999341,21cyclictest20613-21ssh10:40:172
32309993411,5cyclictest7850irq/56-dwc_otg_08:15:172
32309993411,4cyclictest0-21swapper/210:10:562
3231099334,5cyclictest7950irq/56-dwc_otg_12:30:163
3231099333,15cyclictest7950irq/56-dwc_otg_09:55:343
3231099333,15cyclictest7950irq/56-dwc_otg_09:55:343
3231099331,17cyclictest0-21swapper/311:10:433
3230999337,24cyclictest25016-21ssh10:45:292
3230999331,20cyclictest0-21swapper/208:55:322
3231099329,5cyclictest24100-21fschecks_time09:25:323
3231099326,19cyclictest32301-21cyclictest08:20:353
3231099325,5cyclictest7950irq/56-dwc_otg_07:40:453
3231099324,13cyclictest7950irq/56-dwc_otg_08:55:463
3231099323,13cyclictest7950irq/56-dwc_otg_08:05:303
3231099321,5cyclictest10361-21/usr/sbin/munin11:45:353
3231099321,5cyclictest10361-21/usr/sbin/munin11:45:353
3231099321,22cyclictest0-21swapper/308:11:233
32310993211,4cyclictest0-21swapper/310:51:413
32310993211,4cyclictest0-21swapper/310:51:413
32310993210,10cyclictest0-21swapper/310:40:413
3230999328,3cyclictest0-21swapper/211:50:212
3230999327,22cyclictest30501-21ssh12:10:292
3230999327,10cyclictest7850irq/56-dwc_otg_08:30:362
3230999326,5cyclictest7750irq/56-dwc_otg12:00:462
32309993225,4cyclictest2825-21grep07:15:452
3230999321,3cyclictest7750irq/56-dwc_otg09:57:242
3230999321,3cyclictest7750irq/56-dwc_otg09:57:242
32309993213,4cyclictest12073-21swap09:10:452
3230999321,23cyclictest22682-21timerwakeupswit11:20:452
3231099317,14cyclictest0-21swapper/307:10:293
3231099314,16cyclictest7750irq/56-dwc_otg10:00:383
3231099313,15cyclictest7950irq/56-dwc_otg_11:50:343
32310993119,4cyclictest7950irq/56-dwc_otg_10:25:433
32310993111,4cyclictest0-21swapper/311:55:463
3230999319,10cyclictest7750irq/56-dwc_otg12:38:032
3230999318,6cyclictest7950irq/56-dwc_otg_08:00:322
3231099303,4cyclictest7950irq/56-dwc_otg_07:50:443
3230999305,6cyclictest7950irq/56-dwc_otg_08:40:312
3230999301,23cyclictest23474-1kworker/u9:211:55:372
3230999301,19cyclictest3966-21uniq08:50:332
320032304,18sleep220188-21snmpd07:09:522
3231099293,14cyclictest7950irq/56-dwc_otg_12:00:413
3231099291,6cyclictest6489-21unixbench_singl07:25:443
32310992913,5cyclictest1180-21runrttasks07:34:473
32310992913,5cyclictest1180-21runrttasks07:34:473
3231099291,25cyclictest5388-21ls08:55:173
3231099291,19cyclictest0-21swapper/307:49:073
3230999294,5cyclictest7950irq/56-dwc_otg_09:00:422
3230999292,6cyclictest7850irq/56-dwc_otg_08:08:182
145662291,14sleep214672-21uniq07:50:332
3231099289,9cyclictest7950irq/56-dwc_otg_08:39:243
32310992812,5cyclictest3549-21wget07:20:313
3230999287,4cyclictest7950irq/56-dwc_otg_08:49:252
3230999287,4cyclictest7950irq/56-dwc_otg_08:49:252
3230999284,10cyclictest7950irq/56-dwc_otg_07:40:392
3231099271,5cyclictest18338-21cat08:00:353
3231099271,20cyclictest0-21swapper/308:40:303
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional