You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-21 - 02:50

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #7, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack7slot3s.osadl.org (updated Mon Sep 21, 2026 00:43:41)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
102723160,4sleep00-21swapper/019:05:460
897321260,8sleep1225899cyclictest21:45:421
903621040,1sleep20-21swapper/223:50:202
319872990,4sleep231983-21proc_pri22:55:512
319872990,4sleep231983-21proc_pri22:55:512
5542970,4sleep0541-21ssh22:15:510
2257999318,33cyclictest0-21swapper/020:35:370
225799868,50cyclictest4012-21dpkg00:25:240
225799867,51cyclictest0-21swapper/023:50:380
256082840,4sleep3226099cyclictest22:05:553
242592840,2sleep00-21swapper/021:23:440
225799846,55cyclictest11397-21wget19:35:400
225799846,27cyclictest29377-21ssh21:30:400
2257998311,53cyclictest25053-21timerandwakeup20:10:520
2257998010,54cyclictest22654-21fschecks_count23:25:430
225799799,57cyclictest21966-21ssh22:01:210
225799798,57cyclictest22347-21unixbench-2d00:05:550
225799796,62cyclictest5214-21/usr/sbin/munin21:40:440
2257997915,53cyclictest0-21swapper/019:15:540
2257997915,53cyclictest0-21swapper/019:15:540
225799781,63cyclictest15094-21idleruntime-cro22:35:240
225799777,42cyclictest0-21swapper/020:45:380
225799777,42cyclictest0-21swapper/020:45:380
225799774,44cyclictest17763-21tail21:55:560
225799766,56cyclictest25964-21grep20:15:380
2257997624,36cyclictest7973-21fschecks_time22:25:440
2257997612,49cyclictest30348-21ssh22:54:310
183042760,3sleep20-21swapper/223:20:262
2257997510,52cyclictest14644-21switchtime21:10:530
225799745,51cyclictest28950-21taskset00:15:380
225799732,58cyclictest4348-21sh00:25:290
225799728,45cyclictest19424-21aten_rbpower_vo22:40:380
225799726,51cyclictest9708-21ssh21:45:530
2257997227,28cyclictest0-21swapper/021:05:530
2257997210,49cyclictest25699-21sh00:10:480
2257997210,49cyclictest25699-21sh00:10:480
6432710,2sleep10-21swapper/122:15:521
225799702,56cyclictest546-21runrttasks22:57:000
225799702,56cyclictest546-21runrttasks22:57:000
2257997010,32cyclictest18265-21ssh00:00:530
143532700,29sleep27950irq/56-dwc_otg_23:55:522
259472690,4sleep3226099cyclictest21:25:453
259472690,4sleep3226099cyclictest21:25:453
2257996910,46cyclictest28980-21rm21:30:200
2257996910,46cyclictest28980-21rm21:30:200
225799688,43cyclictest0-21swapper/021:35:310
225799688,11cyclictest13902-21unixbench_singl21:50:580
2257996816,37cyclictest18980-21cron22:40:250
2257996814,41cyclictest27984-21fschecks_count20:20:430
225799679,45cyclictest23540-21taskset20:06:080
225799679,32cyclictest0-21swapper/022:10:440
2257996716,5cyclictest18833-21fschecks_time19:55:430
2257996715,43cyclictest101ktimersoftd/022:46:570
2257996715,43cyclictest101ktimersoftd/022:46:570
2257996641,15cyclictest0-21swapper/023:14:230
225799658,43cyclictest4464-21ssh23:01:580
225799653,34cyclictest8973-21seq19:26:510
225799649,24cyclictest0-21swapper/023:58:490
225799638,40cyclictest6299-21rm23:45:500
225799634,43cyclictest13156-21basename19:40:380
225899612,5cyclictest0-21swapper/121:55:551
225799618,27cyclictest11339-21runrttasks21:04:420
2257996113,30cyclictest2861-21grep23:40:560
225799608,28cyclictest0-21swapper/022:24:180
225799608,28cyclictest0-21swapper/022:24:180
225799606,30cyclictest0-21swapper/000:32:530
2257996031,8cyclictest7950irq/56-dwc_otg_20:30:560
2257996031,8cyclictest7950irq/56-dwc_otg_20:30:560
225799601,5cyclictest26484-21diskstats23:30:410
2257996013,29cyclictest21390-21ssh23:24:120
2257996013,29cyclictest101ktimersoftd/021:17:090
2257996011,12cyclictest15708-21ssh00:40:110
211342600,4sleep1221ktimersoftd/121:20:191
225799592,7cyclictest31259-21cat20:30:250
225799592,42cyclictest0-21swapper/023:05:320
225799592,42cyclictest0-21swapper/023:05:320
2257995910,29cyclictest2509-21/usr/sbin/munin19:10:440
226099581,36cyclictest0-21swapper/320:35:373
225799588,18cyclictest30152-21ssh23:35:410
225799587,29cyclictest0-21swapper/019:30:490
225799586,41cyclictest0-21swapper/020:57:040
2257995826,5cyclictest15913-21wc19:45:540
2257995816,20cyclictest101ktimersoftd/022:05:490
2258995711,7cyclictest7950irq/56-dwc_otg_22:55:371
2258995711,7cyclictest7950irq/56-dwc_otg_22:55:371
225799573,36cyclictest15852-21/usr/sbin/munin23:16:010
225799573,36cyclictest15852-21/usr/sbin/munin23:16:010
2257995728,4cyclictest7950irq/56-dwc_otg_19:20:550
225799572,15cyclictest0-21swapper/020:45:250
225999568,36cyclictest0-21swapper/223:05:392
225999568,36cyclictest0-21swapper/223:05:392
2259995621,7cyclictest685-21latency_hist21:35:252
225799568,30cyclictest0-21swapper/019:54:210
2257995611,34cyclictest0-21swapper/020:04:050
2257995611,34cyclictest0-21swapper/020:04:050
226099558,33cyclictest10519-21ssh23:10:313
2259995517,26cyclictest0-21swapper/221:26:182
2259995517,26cyclictest0-21swapper/221:26:182
2257995513,30cyclictest7526-21chrt20:52:050
226099548,28cyclictest0-21swapper/323:05:393
226099548,28cyclictest0-21swapper/323:05:393
225899547,32cyclictest5525-21ssh23:45:391
225899546,16cyclictest0-21swapper/122:10:401
225899542,16cyclictest0-21swapper/123:50:351
81252530,2sleep10-21swapper/119:25:441
226099539,29cyclictest0-21swapper/322:00:393
226099538,28cyclictest0-21swapper/322:35:403
226099538,28cyclictest0-21swapper/320:05:323
225999539,29cyclictest0-21swapper/223:10:312
225999538,29cyclictest0-21swapper/219:25:382
225999533,10cyclictest26564-21cut23:30:422
225999531,26cyclictest0-21swapper/220:40:422
226099528,31cyclictest0-21swapper/320:25:393
226099528,27cyclictest0-21swapper/320:55:393
226099528,27cyclictest0-21swapper/320:50:323
225999528,7cyclictest31-21ksoftirqd/219:40:382
225999527,28cyclictest0-21swapper/220:50:312
225899522,7cyclictest0-21swapper/121:10:371
226099518,29cyclictest0-21swapper/300:00:383
226099518,28cyclictest0-21swapper/320:40:383
226099518,26cyclictest0-21swapper/320:15:383
226099517,26cyclictest0-21swapper/323:25:383
225999518,34cyclictest0-21swapper/220:05:312
225999518,29cyclictest0-21swapper/221:35:392
2259995124,19cyclictest7850irq/56-dwc_otg_22:22:302
2259995124,19cyclictest7850irq/56-dwc_otg_22:22:302
225899511,16cyclictest6932-21ls23:05:441
225899511,16cyclictest6932-21ls23:05:441
226099508,27cyclictest0-21swapper/321:10:393
225999508,28cyclictest0-21swapper/222:50:322
49442490,13sleep3381ktimersoftd/300:25:443
226099498,27cyclictest0-21swapper/320:00:313
226099498,27cyclictest0-21swapper/320:00:313
2260994934,5cyclictest27745-21ssh00:13:403
2260994934,5cyclictest27745-21ssh00:13:403
2260994926,11cyclictest21975-21ssh00:05:513
225999498,28cyclictest0-21swapper/220:30:402
225999498,28cyclictest0-21swapper/220:30:402
245752480,2sleep121-21rcuc/120:10:441
2258994819,16cyclictest10895-21sh22:29:541
2260994716,20cyclictest0-21swapper/322:15:253
225999479,27cyclictest0-21swapper/220:00:312
225999479,27cyclictest0-21swapper/220:00:312
225999478,28cyclictest0-21swapper/220:25:392
225999477,34cyclictest0-21swapper/221:05:312
225899472,5cyclictest7750irq/56-dwc_otg22:35:241
225899471,7cyclictest21620-21ssh21:20:391
226099467,27cyclictest0-21swapper/321:05:313
226099463,26cyclictest0-21swapper/319:40:383
226099462,8cyclictest7950irq/56-dwc_otg_21:00:353
225999468,24cyclictest0-21swapper/223:15:442
225999465,29cyclictest7950irq/56-dwc_otg_23:25:452
225999462,33cyclictest0-21swapper/220:45:402
225999462,33cyclictest0-21swapper/220:45:402
114132460,3sleep211416-21aten_rbpower_vo19:35:402
264382450,2sleep10-21swapper/100:11:031
264382450,2sleep10-21swapper/100:11:031
2260994520,16cyclictest7950irq/56-dwc_otg_00:30:403
225999453,27cyclictest0-21swapper/219:10:272
2259994522,15cyclictest7750irq/56-dwc_otg22:11:572
225899456,17cyclictest7850irq/56-dwc_otg_23:35:261
2258994513,16cyclictest7750irq/56-dwc_otg19:20:481
225899451,28cyclictest24163-21ssh22:05:251
2260994414,18cyclictest37-21rcuc/322:30:283
225999441,25cyclictest0-21swapper/222:19:082
2258994420,7cyclictest2237750wget23:25:391
225899441,28cyclictest16910-21cpuspeed19:50:401
150812440,3sleep30-21swapper/321:53:133
226099438,20cyclictest381ktimersoftd/322:57:033
226099438,20cyclictest381ktimersoftd/322:57:033
226099436,6cyclictest7950irq/56-dwc_otg_22:15:383
226099434,25cyclictest381ktimersoftd/300:35:393
2260994324,11cyclictest3660-21ssh23:42:263
226099431,33cyclictest0-21swapper/322:20:303
226099431,33cyclictest0-21swapper/322:20:303
226099431,30cyclictest0-21swapper/321:48:163
225999439,5cyclictest7750irq/56-dwc_otg21:25:242
225999439,24cyclictest8350-21idleruntime-cro21:45:242
225999431,27cyclictest16203-21systemd-journal19:16:092
225999431,27cyclictest16203-21systemd-journal19:16:092
225899433,32cyclictest7950irq/56-dwc_otg_22:45:391
225899433,32cyclictest7950irq/56-dwc_otg_22:45:391
225899432,17cyclictest7950irq/56-dwc_otg_22:35:441
128002430,2sleep20-21swapper/221:50:432
226099426,22cyclictest30152-21ssh23:35:413
226099421,32cyclictest0-21swapper/319:54:203
226099421,30cyclictest0-21swapper/319:16:093
226099421,30cyclictest0-21swapper/319:16:093
225999428,19cyclictest0-21swapper/223:20:382
225999428,13cyclictest7850irq/56-dwc_otg_23:50:422
225999427,21cyclictest7750irq/56-dwc_otg00:00:462
225999426,23cyclictest7606-21ssh22:25:392
225999422,6cyclictest24230-21cat22:45:542
225999422,6cyclictest24230-21cat22:45:542
2259994224,11cyclictest4405-21ssh23:43:532
2259994218,16cyclictest301ktimersoftd/220:20:462
225999421,7cyclictest13491-21tail00:35:562
225899429,21cyclictest16203-21systemd-journal23:56:351
225899422,9cyclictest7750irq/56-dwc_otg19:10:261
2258994220,8cyclictest210052cat20:00:461
2258994220,8cyclictest210052cat20:00:461
226099415,6cyclictest37-21rcuc/322:49:473
226099415,6cyclictest37-21rcuc/322:49:473
226099412,25cyclictest381ktimersoftd/319:26:373
2260994117,11cyclictest381ktimersoftd/322:50:533
226099411,29cyclictest0-21swapper/323:02:183
225999417,18cyclictest0-21swapper/219:20:392
225999416,25cyclictest7750irq/56-dwc_otg21:15:562
225999415,6cyclictest29-21rcuc/222:03:562
2259994125,8cyclictest7950irq/56-dwc_otg_00:20:402
225999411,23cyclictest0-21swapper/220:35:372
225999411,21cyclictest0-21swapper/220:10:422
2259994111,7cyclictest7750irq/56-dwc_otg20:20:252
2259994110,5cyclictest31-21ksoftirqd/200:25:412
225899418,25cyclictest0-21swapper/122:44:121
225899412,18cyclictest7750irq/56-dwc_otg21:25:431
225899412,18cyclictest7750irq/56-dwc_otg21:25:431
225899411,6cyclictest30721-21grep20:25:561
225899411,30cyclictest0-21swapper/121:10:251
226099408,20cyclictest13319-21diskmemload21:30:443
226099408,17cyclictest0-21swapper/320:30:403
226099408,17cyclictest0-21swapper/320:30:403
226099407,25cyclictest0-21swapper/323:53:113
226099407,19cyclictest37-21rcuc/321:40:413
226099405,6cyclictest29024-21ssh00:15:423
226099404,5cyclictest37-21rcuc/323:32:363
226099404,23cyclictest39-21ksoftirqd/300:20:333
226099402,6cyclictest37-21rcuc/322:44:473
2260994021,11cyclictest23347-21ssh21:21:563
2260994019,12cyclictest18106-21kworker/u8:323:47:383
226099401,31cyclictest0-21swapper/323:19:483
226099401,31cyclictest0-21swapper/323:19:483
225999408,18cyclictest0-21swapper/221:00:352
225999407,6cyclictest31-21ksoftirqd/221:45:542
225999406,23cyclictest15433-21ssh22:35:402
225999405,15cyclictest31-21ksoftirqd/200:10:442
225999405,15cyclictest31-21ksoftirqd/200:10:442
225999401,6cyclictest29-21rcuc/223:04:442
225899406,16cyclictest7950irq/56-dwc_otg_22:25:251
225899406,16cyclictest7950irq/56-dwc_otg_22:25:251
225899401,22cyclictest18119-21ssh23:20:251
225899401,22cyclictest18119-21ssh23:20:251
19772408,22sleep32003-21idleruntime-cro19:10:243
226099399,20cyclictest25241-21grep20:10:543
2260993917,6cyclictest19450-21timerandwakeup23:20:523
226099391,28cyclictest0-21swapper/323:59:193
226099391,23cyclictest5905-21latency_hist20:50:253
226099391,23cyclictest5905-21latency_hist20:50:253
225999397,16cyclictest7750irq/56-dwc_otg23:36:232
225999393,18cyclictest29-21rcuc/200:15:392
225999391,6cyclictest8469-21cut00:30:392
225999391,23cyclictest0-21swapper/222:05:442
225899392,26cyclictest0-21swapper/122:07:031
225899391,29cyclictest4663-21ls19:15:461
225899391,29cyclictest4663-21ls19:15:461
225899391,25cyclictest6847-21ls20:50:471
225899391,25cyclictest4658-21cut20:45:421
225899391,25cyclictest4658-21cut20:45:421
225899391,12cyclictest0-21swapper/121:35:171
225899391,11cyclictest17841-21cat00:00:461
225899391,10cyclictest26949-21cat20:15:531
2258993910,4cyclictest7750irq/56-dwc_otg22:50:371
2258993910,3cyclictest0-21swapper/100:23:291
210482391,3sleep20-21swapper/200:05:282
226099385,23cyclictest836-21ssh21:35:393
2260993819,10cyclictest1180-21runrttasks19:57:403
2260993817,8cyclictest37-21rcuc/319:35:393
226099381,27cyclictest0-21swapper/322:28:183
2260993811,4cyclictest7750irq/56-dwc_otg20:20:443
225999385,24cyclictest7850irq/56-dwc_otg_19:49:372
225999382,5cyclictest7750irq/56-dwc_otg21:55:412
225999381,24cyclictest0-21swapper/222:32:112
225899381,25cyclictest11723-21timerwakeupswit23:10:551
225899381,21cyclictest16025-21ls00:40:251
2258993810,9cyclictest22392-21sed00:05:551
2260993723,9cyclictest381ktimersoftd/319:10:273
225999377,7cyclictest29-21rcuc/221:10:442
225999376,17cyclictest0-21swapper/219:55:372
225899379,6cyclictest0-21swapper/120:20:401
225899377,14cyclictest7950irq/56-dwc_otg_20:35:531
225899376,14cyclictest7950irq/56-dwc_otg_19:30:451
225899372,9cyclictest14908-21/usr/sbin/munin19:45:401
2258993720,5cyclictest31444-21sh00:18:181
225899371,8cyclictest4780-21sort00:25:411
225899371,28cyclictest13718-21chrt19:40:471
225899371,23cyclictest7950irq/56-dwc_otg_20:40:511
225899371,20cyclictest0-21swapper/123:03:261
2258993711,13cyclictest7850irq/56-dwc_otg_23:40:471
2258993710,15cyclictest0-21swapper/121:40:471
226099367,17cyclictest0-21swapper/319:20:393
226099361,22cyclictest0-21swapper/321:17:103
2260993612,12cyclictest15173-21fschecks_count19:45:433
2260993611,16cyclictest10762-21sshd19:31:443
225999362,23cyclictest0-21swapper/219:31:312
2259993612,11cyclictest29-21rcuc/222:42:122
225899367,16cyclictest7950irq/56-dwc_otg_21:00:361
225899365,6cyclictest7750irq/56-dwc_otg23:20:371
225899365,6cyclictest7750irq/56-dwc_otg21:35:491
225899362,21cyclictest0-21swapper/100:30:471
225899361,11cyclictest13235-21ls21:50:491
226099359,14cyclictest0-21swapper/321:55:533
225999353,20cyclictest7850irq/56-dwc_otg_19:50:522
225899358,17cyclictest0-21swapper/120:05:321
225899358,17cyclictest0-21swapper/119:35:391
225999341,11cyclictest8897-21switchtime20:55:532
2258993425,6cyclictest9604-21idleruntime-cro21:00:241
225899341,8cyclictest30884-21ssh23:35:511
17572344,23sleep10-21swapper/119:07:301
225899336,5cyclictest7850irq/56-dwc_otg_20:30:451
225899336,5cyclictest7850irq/56-dwc_otg_20:30:451
225899321,15cyclictest7950irq/56-dwc_otg_19:55:541
4182290,2sleep20-21swapper/219:05:362
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional