You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-31 - 23:00

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #7, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack7slot3s.osadl.org (updated Mon Aug 31, 2026 12:43:39)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
614221870,5sleep3850999cyclictest09:32:263
3119521690,2sleep30-21swapper/308:10:393
3119521690,2sleep30-21swapper/308:10:393
1522721470,5sleep2850899cyclictest09:44:012
85069911267,25cyclictest101ktimersoftd/009:40:420
85069911152,31cyclictest101ktimersoftd/009:10:360
85079910533,17cyclictest20515-21ssh09:10:361
8506991023,85cyclictest0-21swapper/009:45:430
8506991023,85cyclictest0-21swapper/009:45:430
850699995,76cyclictest0-21swapper/009:25:430
8506999849,14cyclictest101ktimersoftd/010:25:270
8506999849,14cyclictest101ktimersoftd/010:25:270
8507999543,36cyclictest13465-21ssh09:40:451
8507999426,29cyclictest19477-21kworker/u8:209:20:401
8506999160,8cyclictest7850irq/56-dwc_otg_09:20:400
850699892,49cyclictest0-21swapper/010:40:260
293562850,2sleep10-21swapper/112:37:391
850999823,53cyclictest17388-21ls09:45:433
850999823,53cyclictest17388-21ls09:45:433
8507997926,37cyclictest7950irq/56-dwc_otg_10:25:271
8507997926,37cyclictest7950irq/56-dwc_otg_10:25:271
8507997913,16cyclictest7850irq/56-dwc_otg_11:00:251
159402770,6sleep37850irq/56-dwc_otg_09:00:143
8507997424,22cyclictest0-21swapper/109:45:421
8507997424,22cyclictest0-21swapper/109:45:421
850999734,25cyclictest37-21rcuc/309:10:383
61662730,3sleep08505-21cyclictest10:11:320
850699697,38cyclictest0-21swapper/008:10:270
850699697,38cyclictest0-21swapper/008:10:270
850899675,36cyclictest31-21ksoftirqd/209:10:362
8507996716,18cyclictest1073-21sh09:25:431
850699655,37cyclictest19489-21diskmemload12:00:270
180062650,2sleep30-21swapper/311:45:243
850999646,8cyclictest381ktimersoftd/309:40:403
850899644,34cyclictest0-21swapper/209:45:432
850899644,34cyclictest0-21swapper/209:45:432
850899643,10cyclictest32174-21/usr/sbin/munin09:25:432
8508996414,20cyclictest7950irq/56-dwc_otg_09:20:412
850699646,44cyclictest0-21swapper/008:25:420
8508996310,32cyclictest0-21swapper/210:25:262
8508996310,32cyclictest0-21swapper/210:25:262
8506996318,31cyclictest5891-21sh12:10:140
79442630,2sleep30-21swapper/310:14:493
8507996223,16cyclictest3729-21taskset11:27:211
850699621,50cyclictest0-21swapper/011:29:020
80982620,6sleep30-21swapper/307:08:273
8507996130,9cyclictest22552-21ls11:10:371
8507996122,20cyclictest1360-21chrt12:04:301
292782610,3sleep129280-21rt-features08:05:381
292782610,3sleep129280-21rt-features08:05:381
8507996021,15cyclictest9762-21ssh11:35:241
8507996020,23cyclictest8890-21/usr/sbin/munin08:40:321
8507996018,27cyclictest7850irq/56-dwc_otg_07:35:281
850699606,39cyclictest0-21swapper/010:25:140
850699601,44cyclictest9667-21sed07:10:410
8507995922,18cyclictest1654-21ssh10:05:511
8507995916,16cyclictest19551-21latency_hist09:10:141
850699591,49cyclictest0-21swapper/011:18:460
850699591,43cyclictest24814-21latency_hist07:55:140
850699591,39cyclictest6539-21fschecks_count12:10:320
8507995822,22cyclictest14720-21ssh10:22:051
850699582,42cyclictest0-21swapper/011:20:330
850699582,42cyclictest0-21swapper/009:18:390
850699582,42cyclictest0-21swapper/009:18:390
850699581,43cyclictest7254-21fschecks_count08:35:300
850699581,43cyclictest14579-21wc07:25:350
850699581,43cyclictest14579-21wc07:25:350
8507995722,22cyclictest15675-21ssh11:41:321
8507995717,27cyclictest10767-21rm10:56:141
8507995713,27cyclictest21597-21latency10:30:361
850699574,36cyclictest8788-21ssh09:35:370
850699571,45cyclictest17598-21latency_hist07:35:140
850699571,42cyclictest20389-21wget09:50:260
850699571,30cyclictest19479-21kworker/u8:309:55:310
850799567,37cyclictest0-21swapper/111:55:271
850799566,9cyclictest7950irq/56-dwc_otg_08:55:251
8507995624,19cyclictest5281-21ssh10:50:311
8507995622,22cyclictest10573-21sh09:37:591
850699561,41cyclictest15468-21grep08:55:420
8509995511,21cyclictest28059-21/usr/sbin/munin09:20:433
8507995529,17cyclictest32613-21ssh11:23:241
8507995521,23cyclictest5779-21ssh12:10:041
8507995520,18cyclictest5938-21sh10:11:081
8507995519,16cyclictest28179-21taskset10:38:591
850699553,43cyclictest11-21rcu_preempt08:40:250
8506995522,23cyclictest17690-21uniq11:05:300
850699551,42cyclictest0-21swapper/008:05:330
850699551,42cyclictest0-21swapper/008:05:330
850699551,40cyclictest12470-21latency_hist08:50:140
850699551,39cyclictest0-21swapper/010:55:370
850799547,35cyclictest0-21swapper/107:25:281
850799547,35cyclictest0-21swapper/107:25:281
8507995421,13cyclictest10993-21ssh12:15:351
8507995418,20cyclictest28699-21sh11:18:481
8507995410,25cyclictest7750irq/56-dwc_otg08:15:251
8506995432,12cyclictest14008-21ssh11:40:290
850699542,38cyclictest0-21swapper/012:20:270
8506995420,14cyclictest14160-21sh12:20:130
850699541,37cyclictest19489-21diskmemload10:45:320
850999536,26cyclictest7850irq/56-dwc_otg_10:25:273
850999536,26cyclictest7850irq/56-dwc_otg_10:25:273
850799535,20cyclictest22191-21ssh11:50:281
8507995324,13cyclictest8813-21ssh12:13:021
8507995317,13cyclictest31482-21sed08:10:421
8507995317,13cyclictest31482-21sed08:10:421
8507995317,12cyclictest28544-21ssh10:00:231
8507995316,13cyclictest17684-21munin-plugin-st09:05:131
850699536,37cyclictest0-21swapper/012:25:370
850699536,37cyclictest0-21swapper/012:25:370
850699535,28cyclictest11974-21latency_hist07:20:140
850699532,41cyclictest0-21swapper/010:01:300
8506995323,7cyclictest7950irq/56-dwc_otg_10:05:230
850699531,41cyclictest0-21swapper/009:00:370
850699531,39cyclictest0-21swapper/008:20:490
8509995213,14cyclictest7950irq/56-dwc_otg_09:25:453
8508995232,6cyclictest7750irq/56-dwc_otg10:40:262
850899522,35cyclictest0-21swapper/209:05:252
850699525,40cyclictest0-21swapper/010:35:260
8506995234,4cyclictest7750irq/56-dwc_otg11:50:130
8506995231,6cyclictest7850irq/56-dwc_otg_08:00:410
8506995216,20cyclictest1180-21runrttasks12:30:300
850699521,41cyclictest0-21swapper/007:40:380
850699521,37cyclictest14315-21/usr/sbin/munin11:00:400
850799516,24cyclictest7750irq/56-dwc_otg09:55:271
850799513,9cyclictest7750irq/56-dwc_otg08:25:251
8507995123,18cyclictest8186-21ssh11:32:571
8507995123,18cyclictest8186-21ssh11:32:571
8507995123,15cyclictest19674-21ssh11:07:241
8507995121,10cyclictest27773-21munin-run09:20:141
8507995121,10cyclictest27773-21munin-run09:20:141
8507995119,15cyclictest4844-21latency_hist10:50:141
8507995116,12cyclictest6757-21munin-run08:35:131
8507995113,13cyclictest10232-21cat07:15:141
8507995112,16cyclictest20270-21rm09:50:171
8506995116,21cyclictest5851-21/usr/sbin/munin08:30:370
850699511,40cyclictest0-21swapper/010:50:330
850699511,39cyclictest1180-21runrttasks10:15:510
850899502,9cyclictest7850irq/56-dwc_otg_08:00:252
8507995026,17cyclictest12168-21chrt08:49:091
8507995016,15cyclictest7058-21basename08:35:271
8506995036,5cyclictest7750irq/56-dwc_otg12:00:140
8506995032,4cyclictest5696-21basename11:30:280
8506995032,4cyclictest5696-21basename11:30:280
8506995030,10cyclictest14138-21latency_hist08:55:130
850699501,40cyclictest0-21swapper/009:05:320
850699501,39cyclictest0-21swapper/011:35:310
850699501,39cyclictest0-21swapper/010:30:180
850699501,37cyclictest519950ssh09:30:420
850699501,35cyclictest21367-21aten_rbpower_vo07:45:280
850699501,35cyclictest0-21swapper/012:35:300
850899497,3cyclictest0-21swapper/208:10:302
850899497,3cyclictest0-21swapper/208:10:302
850899492,39cyclictest17228-21ls11:05:142
8507994912,25cyclictest0-21swapper/107:50:281
850699492,35cyclictest0-21swapper/011:10:290
8507994823,13cyclictest11787-21ssh10:19:161
8507994822,11cyclictest2855-21taskset08:21:531
8507994819,21cyclictest25236-21ssh12:32:401
8507994816,13cyclictest22711-21taskset07:48:571
8507994815,18cyclictest32664-21ssh10:44:391
8507994815,11cyclictest17204-21chrt07:32:411
8507994813,21cyclictest7750irq/56-dwc_otg09:32:361
850699482,30cyclictest0-21swapper/011:51:420
8507994716,13cyclictest21317-21rm11:49:191
850899468,24cyclictest0-21swapper/207:25:192
850899468,24cyclictest0-21swapper/207:25:192
850899467,24cyclictest0-21swapper/210:35:272
850899466,13cyclictest0-21swapper/207:15:252
8507994610,26cyclictest0-21swapper/112:21:101
850699462,35cyclictest0-21swapper/007:23:580
850699461,31cyclictest0-21swapper/008:15:220
81572463,35sleep00-21swapper/007:09:140
8509994517,10cyclictest0-21swapper/308:30:373
850899456,24cyclictest0-21swapper/208:50:272
8507994513,10cyclictest0-21swapper/108:51:331
8506994528,10cyclictest0-21swapper/008:00:080
8509994428,13cyclictest37-21rcuc/312:05:253
850899442,27cyclictest0-21swapper/209:15:262
850899442,27cyclictest0-21swapper/209:15:262
850699442,32cyclictest0-21swapper/007:36:510
850999433,11cyclictest7850irq/56-dwc_otg_08:35:263
850899436,22cyclictest0-21swapper/208:30:282
8507994315,11cyclictest28445-21sed08:05:141
8507994315,11cyclictest22367-21runrttasks12:30:091
8507994315,11cyclictest22367-21runrttasks12:30:091
8507994231,7cyclictest25334-21irqstats07:55:341
8507994214,12cyclictest0-21swapper/107:22:181
850899419,6cyclictest0-21swapper/210:00:302
850899411,6cyclictest14497-21ssh12:20:252
850999404,6cyclictest7950irq/56-dwc_otg_10:30:273
8507994013,12cyclictest0-21swapper/107:16:581
8509993919,5cyclictest381ktimersoftd/312:35:423
8509993818,13cyclictest1173950ssh10:58:023
850899387,11cyclictest7950irq/56-dwc_otg_07:55:322
850899383,16cyclictest0-21swapper/211:40:252
850999371,3cyclictest0-21swapper/310:00:333
8509993713,16cyclictest0-21swapper/311:12:403
850999371,23cyclictest23419-21ls07:50:333
850899376,10cyclictest7950irq/56-dwc_otg_10:33:432
8508993714,14cyclictest19489-21diskmemload12:03:162
850899371,26cyclictest17710-21ls09:05:142
8508993712,5cyclictest0-21swapper/212:00:142
8509993619,9cyclictest39-21ksoftirqd/308:40:253
8509993617,4cyclictest37-21rcuc/312:15:423
850899363,16cyclictest7850irq/56-dwc_otg_07:10:272
8507993621,12cyclictest19570-21cut07:40:281
220332360,5sleep2850899cyclictest09:51:212
850999358,14cyclictest24337-21sh09:15:313
850999358,14cyclictest24337-21sh09:15:313
850999353,8cyclictest7850irq/56-dwc_otg_10:45:273
850999353,11cyclictest7950irq/56-dwc_otg_08:55:143
850999352,5cyclictest7950irq/56-dwc_otg_09:55:423
850999352,5cyclictest7850irq/56-dwc_otg_09:05:263
8509993515,5cyclictest381ktimersoftd/307:35:343
850999351,24cyclictest28902-21ls10:40:133
850899355,6cyclictest19193-21unixbench-2d11:45:412
850899351,23cyclictest4716-21ssh10:50:142
850999346,10cyclictest7950irq/56-dwc_otg_11:04:313
850999345,23cyclictest17412-21ssh11:05:253
850999345,11cyclictest7950irq/56-dwc_otg_07:45:333
8509993423,9cyclictest28537-21aten_rbpower_en08:05:273
8509993423,9cyclictest28537-21aten_rbpower_en08:05:273
850999342,26cyclictest0-21swapper/309:50:293
8509993415,5cyclictest1180-21runrttasks11:54:123
850899348,12cyclictest0-21swapper/212:30:162
850899347,14cyclictest7950irq/56-dwc_otg_11:10:392
850899345,23cyclictest31-21ksoftirqd/210:50:262
8508993426,6cyclictest5879-21ssh11:30:302
8508993426,6cyclictest5879-21ssh11:30:302
850899341,3cyclictest0-21swapper/210:25:022
8508993413,5cyclictest11141-21if_wlan008:45:332
850899341,20cyclictest0-21swapper/210:05:232
850999336,13cyclictest7950irq/56-dwc_otg_12:30:303
850999335,4cyclictest7850irq/56-dwc_otg_10:50:263
850999335,13cyclictest7950irq/56-dwc_otg_12:30:153
850999335,13cyclictest7950irq/56-dwc_otg_12:30:153
850999334,4cyclictest0-21swapper/311:39:483
850999333,10cyclictest7850irq/56-dwc_otg_10:40:293
850999331,4cyclictest7850irq/56-dwc_otg_10:05:263
8509993312,11cyclictest0-21swapper/310:21:583
850899338,13cyclictest0-21swapper/210:55:422
850899336,15cyclictest0-21swapper/209:30:252
850899335,5cyclictest7750irq/56-dwc_otg12:10:252
850899333,8cyclictest854050ssh09:35:342
850899333,14cyclictest7750irq/56-dwc_otg10:20:142
850899331,15cyclictest7850irq/56-dwc_otg_08:05:412
850899331,15cyclictest7850irq/56-dwc_otg_08:05:412
850999326,14cyclictest37-21rcuc/311:55:273
8509993213,5cyclictest8258-21sh09:35:303
8509993211,5cyclictest26708-21cut08:00:273
850899326,4cyclictest0-21swapper/210:10:402
850899325,5cyclictest7750irq/56-dwc_otg08:55:382
850899324,6cyclictest7850irq/56-dwc_otg_11:50:442
850899324,14cyclictest7950irq/56-dwc_otg_11:27:182
8508993218,8cyclictest20807-21rm11:09:292
850899321,27cyclictest1367-21ls11:25:142
850899321,20cyclictest3152-21ssh12:05:412
81442323,23sleep20-21swapper/207:09:042
850999319,4cyclictest0-21swapper/311:41:183
850999317,21cyclictest0-21swapper/311:15:283
850999315,19cyclictest1545-21ssh11:25:283
850999311,20cyclictest9031-21ssh12:13:253
850999311,17cyclictest16474-21idleruntime09:00:323
850899314,4cyclictest0-21swapper/207:35:422
850899312,9cyclictest0-21swapper/207:40:552
8508993110,4cyclictest11705-21ssh12:15:462
850999302,13cyclictest0-21swapper/307:28:063
850999302,13cyclictest0-21swapper/307:28:063
850899307,12cyclictest7950irq/56-dwc_otg_07:35:132
8508993024,4cyclictest18965-21fschecks_time12:25:322
8508993024,4cyclictest18965-21fschecks_time12:25:322
850899301,6cyclictest0-21swapper/209:56:592
153972300,5sleep3850999cyclictest12:20:383
850999297,3cyclictest7750irq/56-dwc_otg08:15:273
850999297,11cyclictest0-21swapper/311:30:313
850999297,11cyclictest0-21swapper/311:30:313
850999294,10cyclictest7950irq/56-dwc_otg_07:10:343
850999292,5cyclictest7850irq/56-dwc_otg_10:15:233
8509992917,8cyclictest37-21rcuc/312:00:253
850899295,4cyclictest7750irq/56-dwc_otg11:35:252
850899294,4cyclictest0-21swapper/211:16:122
850899293,6cyclictest7950irq/56-dwc_otg_12:35:412
850899292,20cyclictest7850irq/56-dwc_otg_08:15:412
850899291,8cyclictest31-21ksoftirqd/208:35:242
850999283,5cyclictest39-21ksoftirqd/307:40:433
8509992822,4cyclictest381ktimersoftd/307:20:263
8509992819,5cyclictest37-21rcuc/307:55:363
850899287,18cyclictest0-21swapper/208:20:272
850899284,15cyclictest8394-21kworker/2:008:40:422
8508992811,6cyclictest3367-21/usr/sbin/munin08:25:362
81432287,12sleep10-21swapper/107:09:031
850999271,8cyclictest3240-21grep08:25:133
8509992716,9cyclictest7950irq/56-dwc_otg_11:20:323
850899277,5cyclictest0-21swapper/207:20:272
850899274,11cyclictest7950irq/56-dwc_otg_07:50:062
850999263,11cyclictest3367-21/usr/sbin/munin08:25:323
850999261,5cyclictest0-21swapper/307:30:253
850999251,13cyclictest7950irq/56-dwc_otg_07:16:563
8508992518,5cyclictest24161-21grep07:50:432
850999241,14cyclictest0-21swapper/308:48:053
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional