You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-07 - 21:10

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #7, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack7slot3s.osadl.org (updated Sun Dec 07, 2025 12:43:36)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
19522999218,62cyclictest12830-21fschecks_time09:30:340
180682900,4sleep318070-21fschecks_count08:35:323
1952299886,74cyclictest0-21swapper/010:45:280
1952299886,74cyclictest0-21swapper/010:45:280
19522998813,61cyclictest15468-21latency_hist11:05:140
230952870,2sleep00-21swapper/008:50:150
19522998715,56cyclictest3119-21wget12:15:290
19522998715,56cyclictest3119-21wget12:15:290
19522998421,42cyclictest0-21swapper/010:20:270
19522998313,50cyclictest16116-21latency_hist11:50:140
1952299823,62cyclictest0-21swapper/011:30:270
1952299815,51cyclictest0-21swapper/010:40:260
19522998118,49cyclictest12347-21latency_hist10:15:150
19522998021,46cyclictest0-21swapper/009:25:270
19522998013,53cyclictest27202-21fschecks_count09:00:310
19522998011,58cyclictest30616-21/usr/sbin/munin07:40:320
207842790,6sleep27850irq/56-dwc_otg_09:40:412
19522997816,45cyclictest24733-21cron07:25:140
19522997816,45cyclictest24733-21cron07:25:140
19522997713,51cyclictest14482-21tune2fs08:25:350
1952299763,57cyclictest0-21swapper/011:08:080
1952299751,52cyclictest0-21swapper/010:15:250
19522997512,53cyclictest4829-21mv09:19:390
19522997421,17cyclictest1499-21ssh10:00:260
19522997421,17cyclictest1499-21ssh10:00:260
1952299721,58cyclictest27096-21grep07:30:370
19522997212,36cyclictest30337-21runrttasks09:55:230
19522997210,42cyclictest0-21swapper/011:50:370
129162720,3sleep312915-21ssh09:30:353
19522997112,43cyclictest6117-21ls09:20:380
19522997111,43cyclictest12871-21sed08:20:380
61302700,5sleep11952399cyclictest10:05:441
1952299694,41cyclictest31716-21ssh12:10:250
19522996917,11cyclictest0-21swapper/009:50:270
1952299691,53cyclictest7012-21aten_rbpower_vo12:20:290
19522996912,46cyclictest6462-21/usr/sbin/munin10:50:500
19522996817,37cyclictest22889-21ssh11:58:380
19522996811,43cyclictest0-21swapper/009:11:430
19522996810,45cyclictest28564-21/usr/sbin/munin07:35:370
19522996810,41cyclictest0-21swapper/009:41:280
19522996810,40cyclictest0-21swapper/012:26:370
1952299678,43cyclictest0-21swapper/012:30:450
19522996717,39cyclictest10449-21ssh10:56:440
19522996716,37cyclictest28654-21rm11:22:150
19522996713,42cyclictest17493-21ssh09:36:040
279072660,2sleep027909-21rm10:35:420
1952299669,40cyclictest0-21swapper/010:26:190
1952299666,46cyclictest0-21swapper/011:15:390
1952299666,46cyclictest0-21swapper/011:15:390
19522996613,39cyclictest26173-21ssh09:49:420
19522996612,37cyclictest955-21taskset07:46:070
1952299657,50cyclictest0-21swapper/012:37:490
1952299656,47cyclictest0-21swapper/012:00:340
19522996521,24cyclictest0-21swapper/009:05:280
1952299651,47cyclictest22926-21cron07:20:140
19522996510,42cyclictest30240-21ssh11:25:210
165322650,2sleep30-21swapper/309:35:343
1952299648,37cyclictest0-21swapper/011:36:190
1952299629,40cyclictest0-21swapper/010:30:360
1952299626,42cyclictest0-21swapper/008:00:340
1952299625,38cyclictest0-21swapper/007:25:250
1952299621,45cyclictest12450-21latency_hist11:45:150
1952299618,39cyclictest21038-21chrt07:14:310
1952299618,38cyclictest0-21swapper/008:55:250
1952299617,42cyclictest0-21swapper/011:10:530
1952299616,45cyclictest31406-21idleruntime-cro12:10:140
1952299612,46cyclictest19677-21aten_rbpower_en08:40:300
1952299607,41cyclictest0-21swapper/010:06:310
1952299606,46cyclictest0-21swapper/007:55:290
1952299602,44cyclictest9909-21grep08:10:430
19522996015,29cyclictest1120-21runrttasks08:07:040
1952499599,20cyclictest30633-21ssh09:10:262
1952299597,40cyclictest0-21swapper/007:53:440
19522995913,37cyclictest10561-21chrt08:15:170
19522995812,31cyclictest18281-21kernelversion08:35:350
19522995614,6cyclictest0-21swapper/008:30:260
1952499547,33cyclictest0-21swapper/211:35:282
1952499538,8cyclictest7950irq/56-dwc_otg_10:00:272
1952499538,8cyclictest7950irq/56-dwc_otg_10:00:272
19524995336,13cyclictest7950irq/56-dwc_otg_10:05:282
1952499529,10cyclictest24108-21ssh12:00:272
1952499517,5cyclictest7850irq/56-dwc_otg_10:50:272
1952299516,16cyclictest23479-21cut08:50:330
1952499508,6cyclictest7950irq/56-dwc_otg_12:30:252
1952499507,29cyclictest23082-21ssh09:45:212
1952499502,5cyclictest7950irq/56-dwc_otg_11:18:272
1952499502,5cyclictest7950irq/56-dwc_otg_11:18:272
1952499493,10cyclictest0-21swapper/209:30:282
19524994910,15cyclictest27383-21/usr/sbin/munin09:00:332
1952399493,22cyclictest7950irq/56-dwc_otg_08:10:281
1952499486,12cyclictest3426-21fschecks_time12:15:342
1952499486,12cyclictest3426-21fschecks_time12:15:342
1952399481,3cyclictest27017-21ssh10:35:291
1952499478,23cyclictest17415-21/usr/sbin/munin11:50:432
1952399477,26cyclictest0-21swapper/112:05:281
1952399477,26cyclictest0-21swapper/111:40:211
1952699467,25cyclictest0-21swapper/307:30:283
1952499469,20cyclictest19175-21rm12:35:282
1952499467,25cyclictest0-21swapper/212:20:282
1952399467,26cyclictest0-21swapper/109:25:201
190542463,13sleep00-21swapper/007:07:460
259352450,2sleep10-21swapper/108:55:391
1952499458,23cyclictest0-21swapper/208:10:292
1952499457,23cyclictest0-21swapper/208:35:292
1952499452,8cyclictest0-21swapper/209:50:272
19524994514,13cyclictest25285-21grep08:55:292
1952399457,25cyclictest0-21swapper/108:00:281
17732451,4sleep10-21swapper/109:15:291
1952499449,12cyclictest1076550ssh11:42:132
1952499447,13cyclictest31453-21timerwakeupswit09:55:452
19524994412,15cyclictest18519-21taskset09:38:242
1952399448,23cyclictest0-21swapper/110:25:311
1952399447,23cyclictest0-21swapper/112:00:301
1952399447,23cyclictest0-21swapper/108:15:281
1952399446,24cyclictest8810-21ssh10:10:271
1952399446,23cyclictest23070-21ssh09:45:201
19523994418,6cyclictest26377-21cron11:20:141
19523994418,6cyclictest26377-21cron11:20:141
1952499437,24cyclictest0-21swapper/209:15:282
1952499437,22cyclictest0-21swapper/207:45:272
1952499433,15cyclictest0-21swapper/210:55:292
19524994328,5cyclictest7750irq/56-dwc_otg11:08:072
1952499432,6cyclictest0-21swapper/208:15:262
19524994317,15cyclictest301ktimersoftd/212:10:182
19524994313,6cyclictest301ktimersoftd/210:45:332
19524994313,6cyclictest301ktimersoftd/210:45:332
19524994310,5cyclictest7950irq/56-dwc_otg_12:05:282
19524994310,19cyclictest32674-21ssh11:28:112
19524994310,12cyclictest14636-21ssh10:17:402
1952399437,23cyclictest0-21swapper/107:10:281
1952699426,9cyclictest0-21swapper/308:55:263
1952499427,23cyclictest0-21swapper/208:40:302
1952499427,21cyclictest0-21swapper/207:35:282
1952499426,12cyclictest8511-21munin-run09:25:142
1952499423,23cyclictest14267-21ssh11:02:312
19524994212,7cyclictest13098-21ntp_states08:20:422
281092410,3sleep121-21rcuc/109:00:421
19526994111,5cyclictest7950irq/56-dwc_otg_12:35:273
1952499417,22cyclictest0-21swapper/207:29:372
1952499415,19cyclictest29735-21ssh10:39:062
19524994116,13cyclictest0-21swapper/211:10:292
19524994111,13cyclictest8908-21/usr/sbin/munin09:25:262
1952499410,26cyclictest0-21swapper/210:14:562
1952399416,24cyclictest0-21swapper/108:20:321
1952399415,23cyclictest7950irq/56-dwc_otg_10:00:381
1952399415,23cyclictest7950irq/56-dwc_otg_10:00:381
19523994123,4cyclictest17734-21sh12:33:191
19523994111,16cyclictest7950irq/56-dwc_otg_11:10:271
248812400,2sleep337-21rcuc/311:16:553
248812400,2sleep337-21rcuc/311:16:553
1952699408,18cyclictest7850irq/56-dwc_otg_08:50:293
1952699402,9cyclictest0-21swapper/307:50:253
1952499406,20cyclictest267332sleep211:20:282
19524994010,18cyclictest7950irq/56-dwc_otg_11:30:332
1952399404,4cyclictest23259-21wget07:20:301
1952399404,4cyclictest23259-21wget07:20:301
289162390,1sleep30-21swapper/309:52:373
1952499397,21cyclictest0-21swapper/207:55:282
1952499393,14cyclictest8294-21taskset08:07:262
1952499392,21cyclictest23094-21ssh11:59:062
1952499391,23cyclictest0-21swapper/207:40:282
1952499390,18cyclictest7750irq/56-dwc_otg10:20:322
1952399396,22cyclictest1410-21ssh11:30:291
1952699387,7cyclictest29086-21grep09:05:493
1952699385,17cyclictest7750irq/56-dwc_otg09:25:213
1952699383,4cyclictest7950irq/56-dwc_otg_11:05:283
1952499388,16cyclictest6671-21seq08:04:462
1952499385,7cyclictest7750irq/56-dwc_otg08:30:262
19524993810,4cyclictest13376-21ntp_states11:45:382
1952499380,13cyclictest24911-21latency_hist07:25:152
1952499380,13cyclictest24911-21latency_hist07:25:152
19523993814,10cyclictest32269-21taskset12:10:341
19523993812,6cyclictest1120-21runrttasks09:59:591
19523993811,8cyclictest0-21swapper/108:05:251
1952699378,17cyclictest7850irq/56-dwc_otg_08:05:143
1952699374,24cyclictest32692-21switchtime12:10:413
1952699371,20cyclictest11717-21unixbench_singl08:15:433
1952499379,11cyclictest140-21systemd-journal10:34:402
1952499377,13cyclictest3030850diskmemload10:28:452
1952699366,9cyclictest39-21ksoftirqd/309:40:263
1952699362,20cyclictest0-21swapper/311:22:003
19526993616,5cyclictest1120-21runrttasks08:46:463
1952699361,25cyclictest12751-21latency11:00:353
1952499363,7cyclictest7850irq/56-dwc_otg_12:25:262
1952499361,23cyclictest1789-21uniq07:50:332
19524993610,9cyclictest23217-21apt-get08:50:262
19524993610,16cyclictest32548-21ssh10:42:192
1952399369,5cyclictest7750irq/56-dwc_otg09:06:141
19523993613,7cyclictest16618-21fschecks_count10:20:341
1952399361,24cyclictest4782-21ssh12:16:411
1952399361,24cyclictest4782-21ssh12:16:411
19523993612,12cyclictest21-21rcuc/111:55:261
19523993611,5cyclictest0-21swapper/109:44:111
19523993611,14cyclictest0-21swapper/111:00:421
68062350,5sleep31952699cyclictest10:51:273
1952699359,6cyclictest7850irq/56-dwc_otg_10:20:153
1952699359,15cyclictest0-21swapper/312:23:383
1952699357,5cyclictest7950irq/56-dwc_otg_11:50:293
1952699356,11cyclictest7850irq/56-dwc_otg_07:25:413
1952699351,24cyclictest21518-21cpuspeed07:15:313
1952699351,23cyclictest20513-21ssh11:55:313
1952499358,7cyclictest0-21swapper/207:19:462
1952499357,14cyclictest0-21swapper/207:12:242
1952499351,3cyclictest7950irq/56-dwc_otg_08:45:262
19524993513,5cyclictest7950irq/56-dwc_otg_08:25:422
1952399358,4cyclictest0-21swapper/112:39:341
1952399356,6cyclictest7850irq/56-dwc_otg_11:45:321
1952399356,4cyclictest0-21swapper/107:30:281
1952399356,25cyclictest7950irq/56-dwc_otg_11:50:281
1952399353,3cyclictest7750irq/56-dwc_otg11:05:321
1952399351,4cyclictest7750irq/56-dwc_otg09:20:271
1952399351,21cyclictest1782-21diskmemload10:45:281
1952399351,21cyclictest1782-21diskmemload10:45:281
19526993423,4cyclictest7950irq/56-dwc_otg_09:55:413
1952699342,10cyclictest2736-21sed10:00:443
1952699342,10cyclictest2736-21sed10:00:443
19526993417,13cyclictest7950irq/56-dwc_otg_09:45:443
19526993414,5cyclictest2378-21sh09:15:353
19523993424,7cyclictest21178-21latency_hist08:45:141
1952399342,23cyclictest31546-21timerandwakeup10:40:421
1952399341,4cyclictest21-21rcuc/109:54:321
1952399341,14cyclictest10978-21wget12:25:291
1952699338,5cyclictest7850irq/56-dwc_otg_07:55:433
1952699338,5cyclictest7750irq/56-dwc_otg10:50:153
1952699338,5cyclictest7750irq/56-dwc_otg10:50:153
1952699335,20cyclictest0-21swapper/310:08:313
1952699335,14cyclictest7850irq/56-dwc_otg_07:35:403
1952699334,6cyclictest5785-21fschecks_time09:20:343
1952699333,14cyclictest0-21swapper/311:40:343
19526993314,5cyclictest12706-21fschecks_time08:20:363
19526993311,4cyclictest0-21swapper/311:25:333
1952699331,13cyclictest0-21swapper/309:15:133
19524993312,5cyclictest26769-21apt07:30:252
1952399338,15cyclictest0-21swapper/109:10:281
1952399335,13cyclictest7950irq/56-dwc_otg_08:35:561
1952399332,6cyclictest10675-21latency_hist12:25:141
1952399331,14cyclictest5284-21wget10:50:301
19523993310,5cyclictest0-21swapper/109:35:271
1952699329,4cyclictest0-21swapper/310:20:433
1952699327,22cyclictest0-21swapper/307:20:293
1952699327,22cyclictest0-21swapper/307:20:293
1952699327,12cyclictest140-21systemd-journal10:44:423
1952699326,13cyclictest7850irq/56-dwc_otg_10:15:153
1952699326,12cyclictest7850irq/56-dwc_otg_10:35:153
1952699323,13cyclictest7850irq/56-dwc_otg_08:25:173
19526993212,5cyclictest19783-21fschecks_time11:10:413
19526993211,3cyclictest0-21swapper/311:47:003
1952499321,9cyclictest28774-21wget09:05:282
1952399324,13cyclictest7950irq/56-dwc_otg_09:35:151
1952399321,7cyclictest15883-21munin-plugin-st10:20:141
1952699318,6cyclictest20641-21ntp_states10:25:423
1952699315,3cyclictest7850irq/56-dwc_otg_10:39:253
1952699314,10cyclictest7850irq/56-dwc_otg_12:26:443
1952699311,5cyclictest140-21systemd-journal12:04:573
1952699311,15cyclictest0-21swapper/308:35:143
1952399316,15cyclictest0-21swapper/107:25:281
1952399314,5cyclictest7750irq/56-dwc_otg07:55:361
1952399312,7cyclictest0-21swapper/110:55:341
19523993114,5cyclictest7074-21sh11:37:241
19523993112,8cyclictest24300-21grep08:50:441
1952399311,14cyclictest3306-21ls07:55:151
1952699306,13cyclictest5507-21idleruntime11:35:413
1952699304,23cyclictest0-21swapper/312:30:283
1952699304,23cyclictest0-21swapper/310:55:303
19526993023,5cyclictest1529-21cpu11:30:303
1952699301,5cyclictest29104-21sed12:05:433
1952699301,26cyclictest19720-21ls07:10:293
1952399306,7cyclictest30851-21kernelversion07:40:341
1952399305,9cyclictest0-21swapper/108:46:391
1952399301,5cyclictest24784-21ssh10:30:491
1952399301,19cyclictest31038-21ssh11:25:391
1952699294,22cyclictest0-21swapper/308:05:283
1952699294,17cyclictest7750irq/56-dwc_otg09:00:273
19526992913,4cyclictest3295-21rm12:15:323
19526992913,4cyclictest3295-21rm12:15:323
1952699291,16cyclictest0-21swapper/307:41:463
1952399296,4cyclictest22022-21ntp_kernel_pll_07:15:381
1952399296,10cyclictest7850irq/56-dwc_otg_08:25:381
1952399294,4cyclictest7750irq/56-dwc_otg07:35:341
1952399293,3cyclictest7750irq/56-dwc_otg07:45:331
1952399293,13cyclictest26696-21/usr/sbin/munin11:20:471
1952699281,9cyclictest537-21rt-features07:45:383
1952399282,15cyclictest0-21swapper/108:30:241
189472283,15sleep30-21swapper/307:06:243
1952699271,6cyclictest9109-21fschecks_time08:10:333
189582262,15sleep20-21swapper/207:06:312
189032263,14sleep10-21swapper/107:05:491
1952699251,15cyclictest0-21swapper/308:41:553
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional