You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-01-03 - 07:58

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #7, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack7slot3s.osadl.org (updated Sat Jan 03, 2026 00:43:37)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
151499961,70cyclictest31237-21tune2fs22:00:290
151499931,77cyclictest0-21swapper/019:50:120
246472920,2sleep20-21swapper/223:10:312
151499921,88cyclictest18146-21wget19:55:260
151499913,73cyclictest0-21swapper/021:30:130
1514999121,24cyclictest0-21swapper/023:05:190
151499911,79cyclictest17475-21tune2fs00:20:300
151499901,79cyclictest0-21swapper/020:00:350
151499901,71cyclictest32218-21ntpq23:30:350
151499901,61cyclictest5257-21munin-plugin-st20:50:120
151499882,75cyclictest0-21swapper/000:15:270
151499882,71cyclictest0-21swapper/000:30:370
151499881,72cyclictest7718-21iwlist20:55:320
151499881,66cyclictest22877-21unixbench_multi21:35:400
151499871,67cyclictest23620-21aten_rbpower_cu21:40:240
151499871,66cyclictest20376-21if_eth021:30:310
151499871,66cyclictest20376-21if_eth021:30:310
130292850,3sleep3151999cyclictest19:40:323
151499841,67cyclictest0-21swapper/022:40:400
151499831,69cyclictest0-21swapper/019:24:210
151499821,68cyclictest0-21swapper/023:25:240
151499821,68cyclictest0-21swapper/023:25:240
151499821,67cyclictest0-21swapper/023:16:370
151499821,67cyclictest0-21swapper/020:44:570
151499821,67cyclictest0-21swapper/020:44:570
151499811,67cyclictest16865-21ls19:50:350
151499811,67cyclictest16865-21ls19:50:350
151499811,64cyclictest0-21swapper/019:16:360
151499811,51cyclictest20118-21sh23:00:120
151499811,46cyclictest0-21swapper/022:40:120
151499801,65cyclictest23932-21runrttasks00:37:020
151499801,65cyclictest0-21swapper/023:13:490
151499801,65cyclictest0-21swapper/020:21:210
151499792,68cyclictest0-21swapper/020:32:090
151499791,75cyclictest5750-21/usr/sbin/munin22:20:270
151499791,66cyclictest0-21swapper/023:50:280
151499791,63cyclictest468-21rs:main0
151499791,63cyclictest0-21swapper/023:22:120
151499791,62cyclictest18991-21/usr/sbin/munin00:25:250
151499791,61cyclictest0-21swapper/019:27:150
188252780,2sleep10-21swapper/100:25:121
151499789,50cyclictest1125-21runrttasks19:39:520
1514997826,36cyclictest6068-21cron23:50:120
1514997820,38cyclictest6000-21sed20:50:330
151499781,67cyclictest0-21swapper/021:49:510
151499781,66cyclictest0-21swapper/020:13:320
151499781,65cyclictest0-21swapper/021:55:260
151499781,65cyclictest0-21swapper/021:55:260
151499781,65cyclictest0-21swapper/021:03:280
151499781,64cyclictest0-21swapper/022:29:180
151499781,64cyclictest0-21swapper/022:29:180
151499781,64cyclictest0-21swapper/021:06:300
151499771,69cyclictest0-21swapper/020:29:150
151499771,63cyclictest26499-21taskset20:16:080
151499771,34cyclictest9269-21/usr/sbin/munin23:55:390
151499761,63cyclictest0-21swapper/019:34:400
151499761,58cyclictest0-21swapper/021:11:470
151499751,59cyclictest18018-21chrt22:51:490
151499741,60cyclictest3989-21seq23:41:440
316192730,3sleep231616-21ntp_states22:00:352
151499731,65cyclictest0-21swapper/022:11:130
107122730,2sleep20-21swapper/221:05:122
151499721,60cyclictest0-21swapper/019:42:480
151499721,59cyclictest2828-21taskset19:11:470
151499721,59cyclictest2828-21taskset19:11:470
151499711,56cyclictest1369-21runrttasks20:37:040
151499711,53cyclictest0-21swapper/022:45:290
151499711,50cyclictest128-21systemd-journal20:05:500
151499702,55cyclictest0-21swapper/000:12:210
151499701,54cyclictest0-21swapper/022:34:370
151499701,48cyclictest28633-21chrt21:52:160
151499701,48cyclictest22189-21apt-config23:05:130
151499691,59cyclictest0-21swapper/000:06:530
151499691,59cyclictest0-21swapper/000:06:530
151499691,56cyclictest0-21swapper/021:22:020
151499681,52cyclictest0-21swapper/000:01:190
151499681,51cyclictest0-21swapper/022:17:340
151799672,11cyclictest7750irq/56-dwc_otg23:15:251
151499671,53cyclictest0-21swapper/021:19:240
151899662,18cyclictest14306-21ls19:45:132
151999653,44cyclictest18599-21missed_timers19:55:333
1517996517,42cyclictest0-21swapper/123:05:191
151999646,45cyclictest7850irq/56-dwc_otg_00:11:353
151899642,5cyclictest7750irq/56-dwc_otg22:40:302
151999631,51cyclictest3819-21cat22:15:133
151999617,40cyclictest7950irq/56-dwc_otg_20:45:243
151999616,5cyclictest7950irq/56-dwc_otg_20:55:413
151999614,8cyclictest7950irq/56-dwc_otg_21:55:313
151999614,8cyclictest7950irq/56-dwc_otg_21:55:313
151499611,44cyclictest0-21swapper/022:06:310
151999592,6cyclictest21019-21/usr/sbin/munin20:00:413
151999591,47cyclictest25444-21runrttasks23:11:293
151999591,43cyclictest0-21swapper/323:25:303
151999591,43cyclictest0-21swapper/323:25:303
1517995918,27cyclictest0-21swapper/122:25:191
1517995918,27cyclictest0-21swapper/122:25:191
151999581,4cyclictest5265-21/usr/sbin/munin19:20:423
151999574,8cyclictest7950irq/56-dwc_otg_23:20:423
151999571,6cyclictest14513-21aten_rbpower_vo19:45:283
151999566,5cyclictest7950irq/56-dwc_otg_22:40:273
151899565,9cyclictest0-21swapper/221:25:252
151799564,14cyclictest0-21swapper/123:55:231
151999556,6cyclictest7950irq/56-dwc_otg_00:37:303
151999552,7cyclictest7950irq/56-dwc_otg_21:30:403
151999552,7cyclictest7950irq/56-dwc_otg_21:30:403
1519995514,39cyclictest12573-21cat21:10:133
151999551,42cyclictest0-21swapper/320:50:403
151999545,9cyclictest7950irq/56-dwc_otg_00:20:403
151999541,45cyclictest7950irq/56-dwc_otg_22:20:323
151999537,6cyclictest7950irq/56-dwc_otg_21:01:193
151999536,7cyclictest182302sleep322:54:263
151999536,6cyclictest7950irq/56-dwc_otg_19:40:003
151999534,9cyclictest7950irq/56-dwc_otg_19:50:403
151999534,9cyclictest7950irq/56-dwc_otg_19:50:403
151999533,5cyclictest0-21swapper/321:50:253
151999531,12cyclictest89152chrt22:26:363
151999531,12cyclictest89152chrt22:26:363
151999531,12cyclictest0-21swapper/322:00:403
151999529,39cyclictest0-21swapper/300:10:123
151999529,39cyclictest0-21swapper/300:10:123
151999527,7cyclictest7950irq/56-dwc_otg_20:29:393
151999525,7cyclictest7950irq/56-dwc_otg_20:37:123
151999524,4cyclictest7950irq/56-dwc_otg_00:15:333
151999521,11cyclictest163742sleep322:48:503
151999521,11cyclictest0-21swapper/323:08:213
151999521,10cyclictest0-21swapper/323:50:373
1517995226,5cyclictest5501-21munin-plugin-st22:20:121
151999515,7cyclictest195322sleep321:27:513
151999515,6cyclictest7950irq/56-dwc_otg_21:50:013
151999512,7cyclictest14627-21aten_rbpower_po21:15:273
151999512,38cyclictest7950irq/56-dwc_otg_23:36:203
151999512,10cyclictest0-21swapper/319:32:163
151999511,5cyclictest11346-21/usr/sbin/munin22:35:273
151799515,19cyclictest7850irq/56-dwc_otg_23:10:181
151999507,6cyclictest7950irq/56-dwc_otg_20:14:013
151999507,4cyclictest0-21swapper/320:10:133
151999505,4cyclictest7750irq/56-dwc_otg19:25:343
151999501,8cyclictest2201-21fschecks_time20:40:283
151999501,8cyclictest2201-21fschecks_time20:40:283
151999501,8cyclictest19618-21grep22:55:413
151999501,10cyclictest7950irq/56-dwc_otg_23:58:393
151799504,11cyclictest7750irq/56-dwc_otg20:45:241
151999495,7cyclictest275042chrt23:19:333
151999495,4cyclictest9550irq/80-mmc020:20:133
151999491,9cyclictest14365-21latency_hist21:15:133
151999491,3cyclictest0-21swapper/319:11:353
151999491,3cyclictest0-21swapper/319:11:353
151999483,5cyclictest7950irq/56-dwc_otg_23:00:233
151999482,7cyclictest10630-21grep22:30:403
151999481,9cyclictest0-21swapper/320:21:513
151999481,7cyclictest17025-21ntp_kernel_err21:20:343
151999481,7cyclictest0-21swapper/300:01:263
151899486,16cyclictest0-21swapper/220:35:272
1517994812,23cyclictest0-21swapper/123:30:191
151999473,9cyclictest7850irq/56-dwc_otg_23:41:553
151999473,6cyclictest0-21swapper/321:40:393
151999471,7cyclictest20819-21awk00:30:273
151999471,6cyclictest0-21swapper/300:26:303
151999471,4cyclictest0-21swapper/321:38:363
1519994714,30cyclictest31110-21if_eth020:30:333
151799477,26cyclictest0-21swapper/121:10:251
151799477,25cyclictest0-21swapper/122:55:261
10522472,14sleep00-21swapper/019:07:490
151999462,5cyclictest7850irq/56-dwc_otg_23:47:293
151999461,7cyclictest32411-21cat23:30:383
151999461,7cyclictest1432-21grep22:05:413
151999461,3cyclictest7850irq/56-dwc_otg_19:16:453
151899467,25cyclictest0-21swapper/222:15:252
151899462,4cyclictest0-21swapper/222:45:232
151799469,24cyclictest0-21swapper/119:15:181
151799462,24cyclictest0-21swapper/121:40:241
151899457,24cyclictest0-21swapper/221:45:262
151799458,24cyclictest0-21swapper/100:05:261
151799458,24cyclictest0-21swapper/100:05:261
151799457,22cyclictest0-21swapper/120:20:271
151799455,23cyclictest23-21ksoftirqd/122:35:241
151799449,12cyclictest0-21swapper/121:25:241
151799441,13cyclictest7750irq/56-dwc_otg00:15:301
151999432,8cyclictest0-21swapper/322:18:173
1518994319,6cyclictest3106-21idleruntime-cro19:15:122
1518994319,6cyclictest3106-21idleruntime-cro19:15:122
1518994317,12cyclictest301ktimersoftd/222:30:232
1517994321,8cyclictest12465-21cron21:10:121
151799431,6cyclictest7750irq/56-dwc_otg00:00:261
151799428,24cyclictest0-21swapper/120:15:291
151799427,22cyclictest0-21swapper/120:05:261
1518994112,6cyclictest0-21swapper/220:45:402
151799416,23cyclictest0-21swapper/122:40:261
1517994119,4cyclictest1676850wget22:50:251
1518994016,4cyclictest31364-21apt-config23:30:132
1518994016,4cyclictest31364-21apt-config23:30:132
151799407,24cyclictest0-21swapper/123:00:251
151799407,23cyclictest0-21swapper/123:25:261
151799407,23cyclictest0-21swapper/123:25:261
151799401,7cyclictest20105-21grep20:00:301
151899391,7cyclictest0-21swapper/220:05:252
151799397,23cyclictest0-21swapper/121:50:171
151799392,6cyclictest0-21swapper/120:55:251
151799387,22cyclictest0-21swapper/123:35:271
151799383,8cyclictest0-21swapper/121:30:241
151799383,8cyclictest0-21swapper/121:30:241
1517993810,5cyclictest0-21swapper/122:10:221
151899374,6cyclictest7750irq/56-dwc_otg21:50:182
151899374,23cyclictest7950irq/56-dwc_otg_23:40:222
1518993719,4cyclictest19876-21wget20:00:262
1518993711,10cyclictest7950irq/56-dwc_otg_19:25:332
151799372,5cyclictest0-21swapper/119:30:261
151799372,4cyclictest0-21swapper/120:50:271
1517993721,8cyclictest14070-21sh19:45:121
151799371,4cyclictest7750irq/56-dwc_otg21:35:251
1518993627,6cyclictest12487-21sh21:10:122
151899361,23cyclictest14682-21cut19:45:312
151899361,21cyclictest5442-21cpuspeed19:20:292
151799368,15cyclictest0-21swapper/119:10:271
151799368,15cyclictest0-21swapper/119:10:271
151799362,9cyclictest0-21swapper/119:45:271
151799362,6cyclictest7850irq/56-dwc_otg_23:50:241
151899357,16cyclictest0-21swapper/223:05:182
151899357,13cyclictest7950irq/56-dwc_otg_20:25:122
151899355,3cyclictest0-21swapper/220:10:272
1518993514,4cyclictest17272-21aten_rbpower_po00:20:272
1517993518,5cyclictest17186-21sensors_temp21:20:371
208182340,2sleep20-21swapper/223:00:322
151899342,23cyclictest0-21swapper/200:11:442
1518993412,12cyclictest20992-21sed21:30:402
1518993412,12cyclictest20992-21sed21:30:402
151799347,24cyclictest0-21swapper/123:40:251
151799346,6cyclictest0-21swapper/100:25:231
151799341,26cyclictest23650-21cpuspeed20:10:291
327342334,19sleep1341-21ntp_kernel_pll_19:05:351
151899338,5cyclictest7950irq/56-dwc_otg_21:20:402
151899337,7cyclictest7950irq/56-dwc_otg_20:55:122
151899333,19cyclictest0-21swapper/222:57:382
1518993317,5cyclictest22665-21switchtime21:35:382
1518993312,4cyclictest641850wget23:50:262
151899331,23cyclictest25533-21cut20:15:322
151799339,6cyclictest31002-21cut22:00:261
151799337,13cyclictest24337-21latency_hist00:40:131
151899327,7cyclictest7950irq/56-dwc_otg_00:20:122
151899326,14cyclictest0-21swapper/221:40:242
151899326,14cyclictest0-21swapper/220:30:282
151899324,7cyclictest0-21swapper/219:55:242
1518993216,5cyclictest4505-21/usr/sbin/munin23:45:372
1518993213,5cyclictest1485-21missed_timers23:35:342
151799328,8cyclictest0-21swapper/120:40:231
151799328,8cyclictest0-21swapper/120:40:231
151799322,16cyclictest30684-21idleruntime-cro22:00:131
151799322,16cyclictest30684-21idleruntime-cro22:00:131
151799321,22cyclictest31027-21uniq20:30:321
151799321,22cyclictest20986-21cpuspeed00:30:311
151899317,13cyclictest7950irq/56-dwc_otg_23:25:122
151899316,11cyclictest7950irq/56-dwc_otg_23:15:412
151899314,7cyclictest7950irq/56-dwc_otg_22:50:242
1518993114,4cyclictest3679-21latency_hist22:15:122
151899311,24cyclictest12043-21cut00:05:292
151899311,24cyclictest12043-21cut00:05:292
151899311,21cyclictest16401-21cpuspeed19:50:282
151899311,21cyclictest16401-21cpuspeed19:50:282
151799319,11cyclictest7950irq/56-dwc_otg_22:25:121
151799317,16cyclictest7950irq/56-dwc_otg_22:48:021
151799312,18cyclictest0-21swapper/119:25:351
1517993121,7cyclictest221ktimersoftd/123:45:261
151799311,5cyclictest0-21swapper/100:10:321
151799311,3cyclictest7950irq/56-dwc_otg_23:20:271
151899308,10cyclictest7850irq/56-dwc_otg_00:00:132
151899303,10cyclictest11265-21/usr/sbin/munin22:35:242
151899302,8cyclictest6305-21memory22:20:342
151899302,19cyclictest0-21swapper/200:37:442
151899301,9cyclictest7750irq/56-dwc_otg22:25:312
151899301,9cyclictest7750irq/56-dwc_otg22:25:312
151899301,8cyclictest7750irq/56-dwc_otg20:40:252
151899301,8cyclictest7750irq/56-dwc_otg20:40:252
151899301,26cyclictest10944-21ls00:00:402
151899301,18cyclictest29189-21cut20:25:312
151799302,11cyclictest7750irq/56-dwc_otg20:25:271
151799302,11cyclictest7750irq/56-dwc_otg19:55:381
151799301,18cyclictest0-21swapper/121:00:331
151799301,14cyclictest380-21aten_rbpower_vo22:05:281
151899293,6cyclictest7850irq/56-dwc_otg_23:30:142
151899292,20cyclictest0-21swapper/221:19:032
151899292,17cyclictest0-21swapper/200:30:362
1518992914,4cyclictest12048-21resolvconf19:37:432
1518992912,4cyclictest9101-21/usr/sbin/munin19:30:282
1518992911,5cyclictest12762-21cut21:10:252
1518992910,4cyclictest1125-21runrttasks19:15:152
151799298,5cyclictest7850irq/56-dwc_otg_19:20:371
1517992913,4cyclictest25799-21if_err_wlan021:45:311
151799291,12cyclictest7750irq/56-dwc_otg19:50:391
151799291,12cyclictest7750irq/56-dwc_otg19:50:391
151899282,9cyclictest7850irq/56-dwc_otg_20:55:312
151899282,13cyclictest0-21swapper/222:05:492
151799286,5cyclictest11389-21taskset19:35:351
151799285,12cyclictest7950irq/56-dwc_otg_20:35:411
151799283,5cyclictest0-21swapper/122:30:261
151799282,15cyclictest0-21swapper/121:18:011
12482284,14sleep21510-21date19:10:132
151899272,5cyclictest20106-21tail00:25:392
10772273,15sleep30-21swapper/319:08:083
1518992519,3cyclictest0-21swapper/221:55:312
1518992519,3cyclictest0-21swapper/221:55:312
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional