You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-10 - 08:35

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #7, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack7slot3s.osadl.org (updated Fri Jul 10, 2026 00:43:36)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3149921720,2sleep21400299cyclictest23:59:202
1276921420,7sleep01400099cyclictest22:15:470
2143521130,3sleep021436-21sh22:26:220
1899621090,6sleep31400399cyclictest22:24:203
1247621060,2sleep10-21swapper/123:35:391
1247621060,2sleep10-21swapper/123:35:391
758521020,3sleep1221ktimersoftd/123:30:281
193932990,1sleep10-21swapper/100:23:391
14001999648,23cyclictest11821-21ntp_states22:55:421
255322950,5sleep21400299cyclictest00:30:402
1400099867,44cyclictest0-21swapper/000:05:310
1400199854,24cyclictest0-21swapper/122:05:261
3942830,6sleep21400299cyclictest21:20:162
302382830,2sleep10-21swapper/122:38:161
14001998330,15cyclictest7850irq/56-dwc_otg00:10:291
126422830,2sleep00-21swapper/000:15:320
1400299813,10cyclictest11821-21ntp_states22:55:422
14001997913,10cyclictest7950irq/56-dwc_otg_00:15:271
142482770,5sleep21400299cyclictest19:10:332
1400099772,59cyclictest0-21swapper/022:00:270
21682740,4sleep27950irq/56-dwc_otg_22:43:582
14000997445,11cyclictest101ktimersoftd/022:55:410
1400099744,20cyclictest24768-21ssh00:30:290
1400299718,10cyclictest8050irq/56-dwc_otg_22:30:352
1400299718,10cyclictest8050irq/56-dwc_otg_22:30:352
1400099717,38cyclictest0-21swapper/019:50:250
1400099694,56cyclictest24115-21ssh23:50:290
1400099693,7cyclictest0-21swapper/021:40:280
1400299673,53cyclictest7950irq/56-dwc_otg_22:51:492
1400299673,53cyclictest7950irq/56-dwc_otg_22:51:492
14001996735,13cyclictest26744-21ssh21:11:211
14001996735,13cyclictest26744-21ssh21:11:211
14001996728,20cyclictest21622-21/usr/sbin/munin21:00:311
14001996724,23cyclictest7160-21ssh21:28:251
1400099675,44cyclictest0-21swapper/022:35:250
1400099674,25cyclictest0-21swapper/023:45:280
1400299661,55cyclictest0-21swapper/222:17:152
14001996524,16cyclictest19767-21ssh22:25:231
1400299644,50cyclictest24783-21diskmemload21:40:452
1400299642,53cyclictest0-21swapper/220:10:162
1400299641,7cyclictest25161-21/usr/sbin/munin21:10:282
1400299641,7cyclictest25161-21/usr/sbin/munin21:10:282
1400299641,6cyclictest5797-21grep21:25:492
1400299641,51cyclictest0-21swapper/221:47:462
14001996429,20cyclictest18183-21ssh22:22:441
14001996427,23cyclictest9281-21rm22:52:301
14001996427,23cyclictest9281-21rm22:52:301
14001996426,22cyclictest4930-21ssh22:46:381
14001996426,21cyclictest21660-21ssh23:07:321
14001996426,21cyclictest21660-21ssh23:07:321
14000996410,10cyclictest0-21swapper/023:00:280
29162630,1sleep00-21swapper/023:24:550
277422630,1sleep20-21swapper/223:55:012
1400299634,15cyclictest8050irq/56-dwc_otg_20:04:412
14001996326,21cyclictest2794-21ssh21:22:331
14001996326,14cyclictest15501-21ssh21:39:231
14001996324,16cyclictest30679-21ssh21:57:521
14001996321,23cyclictest3563-21fschecks_time20:10:331
14001996320,31cyclictest24223-21sh21:50:231
10532630,2sleep10-21swapper/123:21:301
1400299628,4cyclictest8050irq/56-dwc_otg_00:15:372
1400299626,5cyclictest8050irq/56-dwc_otg_21:55:322
1400299621,5cyclictest19483-21idleruntime-cro22:25:152
1400299621,10cyclictest7850irq/56-dwc_otg22:25:362
14001996228,21cyclictest9938-21ssh21:31:091
14001996226,12cyclictest24463-21perl23:50:341
14001996222,22cyclictest31017-21ssh21:17:021
14001996222,13cyclictest23925-21ssh21:50:141
14001996220,14cyclictest29496-21unixbench_singl23:55:461
182372610,3sleep20-21swapper/223:42:452
1400299618,8cyclictest7950irq/56-dwc_otg_23:45:282
1400299617,9cyclictest8050irq/56-dwc_otg_21:22:422
1400299611,4cyclictest8050irq/56-dwc_otg_00:20:272
14002996113,4cyclictest7950irq/56-dwc_otg_22:05:462
14001996123,20cyclictest2585-21ssh22:03:321
1400299601,49cyclictest0-21swapper/220:10:372
1400299601,3cyclictest0-21swapper/200:00:182
1400299601,18cyclictest0-21swapper/223:18:152
14001996025,21cyclictest19946-21cat21:45:161
14001996024,22cyclictest7336-21ssh00:09:201
14001996020,21cyclictest15808-21modprobe19:15:161
14001996019,14cyclictest24926-21ssh22:30:461
14001996019,14cyclictest24926-21ssh22:30:461
14000996012,3cyclictest0-21swapper/020:55:270
14003995913,24cyclictest8050irq/56-dwc_otg_22:55:413
14001995926,20cyclictest14075-21ssh22:17:261
14001995922,20cyclictest26415-21ssh00:31:231
1400099593,11cyclictest0-21swapper/022:30:350
1400099593,11cyclictest0-21swapper/022:30:350
14000995914,30cyclictest6749-21ssh22:50:150
1400399587,6cyclictest0-21swapper/322:25:273
1400299581,14cyclictest7850irq/56-dwc_otg21:35:442
14001995826,16cyclictest12344-21/usr/sbin/munin20:35:291
14001995824,12cyclictest750-21snmpd19:20:381
14001995822,24cyclictest7850irq/56-dwc_otg22:14:271
14001995814,14cyclictest21176-21modprobe21:00:151
1400099582,34cyclictest32649-21sh22:40:440
1400099581,34cyclictest8920-21ssh22:10:430
1400299578,5cyclictest7850irq/56-dwc_otg21:30:292
1400299574,8cyclictest8050irq/56-dwc_otg_22:38:532
1400299573,5cyclictest0-21swapper/222:49:092
1400299573,11cyclictest0-21swapper/219:15:252
14001995726,12cyclictest15708-21cat19:15:151
14001995722,21cyclictest29523-21ls19:50:421
14001995722,20cyclictest700-21sh22:41:041
14001995722,13cyclictest22727-21chrt19:34:181
1400099572,34cyclictest0-21swapper/022:50:300
1400099572,34cyclictest0-21swapper/022:50:300
1400399564,14cyclictest25107-21ssh21:10:253
1400399564,14cyclictest25107-21ssh21:10:253
1400299568,9cyclictest0-21swapper/223:35:152
14002995619,34cyclictest28124-21latency_hist21:55:162
1400299561,3cyclictest7950irq/56-dwc_otg_20:35:382
14001995628,12cyclictest1613-21ssh00:01:271
14001995617,17cyclictest0-21swapper/123:10:281
14000995631,13cyclictest0-21swapper/020:50:210
14000995625,16cyclictest7950irq/56-dwc_otg_22:10:160
14000995615,23cyclictest15990-21aten_rbpower_vo22:20:320
1400299555,10cyclictest0-21swapper/222:13:152
14001995524,15cyclictest24337-21sed21:05:441
14001995522,9cyclictest14799-21seq20:40:401
14001995519,12cyclictest27729-21cut23:15:311
14000995545,4cyclictest101ktimersoftd/019:20:430
14000995522,9cyclictest0-21swapper/021:05:290
1400099551,28cyclictest28603-21fschecks_time21:55:350
1400299548,4cyclictest8050irq/56-dwc_otg_19:26:162
1400299544,4cyclictest8050irq/56-dwc_otg_20:00:152
1400299543,4cyclictest32096-21fschecks_time23:20:322
1400299542,6cyclictest0-21swapper/219:21:102
1400299542,5cyclictest20771-21wget00:25:322
14001995428,11cyclictest27182-21/usr/sbin/munin19:45:351
14001995420,21cyclictest2985-21chrt20:10:051
14001995419,11cyclictest4220-21ssh23:25:391
1400099549,34cyclictest0-21swapper/021:39:060
1400099546,28cyclictest17639-21ls20:50:160
1400099542,29cyclictest25165-21fschecks_time19:40:320
1400099542,29cyclictest25165-21fschecks_time19:40:320
14000995417,25cyclictest29100-21ssh21:15:320
1400299534,4cyclictest8050irq/56-dwc_otg_19:45:432
1400299532,7cyclictest0-21swapper/222:03:382
1400299532,5cyclictest13719-21rm23:37:032
1400299532,5cyclictest13719-21rm23:37:032
14002995318,33cyclictest4430-21switchtime23:25:422
1400299531,4cyclictest24280-21resolvconf19:36:092
1400299531,3cyclictest7950irq/56-dwc_otg_23:02:432
14002995312,5cyclictest9490-21grep00:10:452
1400299531,11cyclictest8050irq/56-dwc_otg_21:00:432
14001995325,17cyclictest22395-21ssh23:47:471
14001995323,12cyclictest18834-21ssh23:04:541
1400099539,23cyclictest0-21swapper/021:30:310
1400099534,27cyclictest0-21swapper/021:45:260
14000995333,6cyclictest8050irq/56-dwc_otg_00:10:380
1400099532,48cyclictest4628-21wget21:25:320
1400099532,32cyclictest0-21swapper/023:25:320
1400099531,31cyclictest14136-21cut20:40:280
1400099531,30cyclictest1211-21unixbench_singl00:00:480
1400099531,29cyclictest22383-21head19:30:430
1400399522,11cyclictest7850irq/56-dwc_otg00:30:273
1400299523,5cyclictest750-21snmpd20:41:322
1400299522,9cyclictest8050irq/56-dwc_otg_00:40:162
14001995220,23cyclictest24783-21diskmemload00:26:061
14000995227,5cyclictest8319-21ntp_kernel_pll_23:30:380
14000995223,6cyclictest32155-21latency_hist00:00:160
1400099521,28cyclictest750-21snmpd21:50:410
1400299516,4cyclictest0-21swapper/223:07:532
1400299516,4cyclictest0-21swapper/223:07:532
1400299511,5cyclictest25803-21ssh23:12:332
1400299511,5cyclictest22165-21timerandwakeup19:30:412
1400299511,11cyclictest11812-21taskset20:32:302
14001995123,9cyclictest26435-21munin-run19:45:161
14001995123,9cyclictest26435-21munin-run19:45:161
14001995122,13cyclictest32363-21rm00:39:431
14001995121,18cyclictest18202-21ssh23:42:421
14000995126,13cyclictest8050irq/56-dwc_otg_21:20:340
1400099511,28cyclictest16740-21rt-features23:40:420
1400299503,4cyclictest8050irq/56-dwc_otg_19:51:122
1400299502,3cyclictest0-21swapper/200:09:512
14001995016,14cyclictest5852-21processes20:15:391
1400099505,25cyclictest24783-21diskmemload21:10:280
1400099505,25cyclictest24783-21diskmemload21:10:280
1400099501,36cyclictest19507-21ssh23:05:310
1400099501,36cyclictest19507-21ssh23:05:310
14000995013,26cyclictest0-21swapper/021:05:160
14000995010,14cyclictest0-21swapper/000:25:310
14003994924,23cyclictest37-21rcuc/321:20:303
14001994920,14cyclictest750-21snmpd20:46:321
1400099496,5cyclictest0-21swapper/000:37:430
1400399488,29cyclictest0-21swapper/320:10:283
1400399487,27cyclictest0-21swapper/320:50:213
1400399481,8cyclictest8050irq/56-dwc_otg_19:30:263
1400299481,11cyclictest727-21runrttasks20:18:382
14001994817,18cyclictest727-21runrttasks20:29:401
14001994813,11cyclictest0-21swapper/120:05:161
1400099489,18cyclictest0-21swapper/000:20:370
135182483,12sleep00-21swapper/019:07:280
1400299471,3cyclictest7950irq/56-dwc_otg_20:49:102
14002994712,5cyclictest23428-21sh21:05:322
14001994711,10cyclictest8050irq/56-dwc_otg_20:50:351
1400099473,18cyclictest27625-21ssh23:15:280
1400099471,4cyclictest1210-21munin-run20:05:150
14000994714,24cyclictest0-21swapper/020:09:140
14000994712,25cyclictest0-21swapper/020:35:430
14001994615,16cyclictest243912chrt19:37:281
14001994613,12cyclictest20706-21seq19:26:331
1400099462,23cyclictest0-21swapper/023:35:350
1400099462,23cyclictest0-21swapper/023:35:350
14000994615,18cyclictest24736-21grep23:10:430
1400099451,23cyclictest14020-21/usr/sbin/munin19:10:360
1400099451,20cyclictest0-21swapper/019:25:410
1400399448,23cyclictest0-21swapper/320:05:283
1400399447,25cyclictest31709-21ssh22:40:303
1400399442,38cyclictest7576-21latency_hist22:10:163
14001994419,12cyclictest8115-21taskset20:21:161
14001994419,12cyclictest8115-21taskset20:21:161
14001994413,11cyclictest7950irq/56-dwc_otg_19:55:351
14000994414,19cyclictest727-21runrttasks19:15:260
292372430,4sleep313999-21cyclictest22:36:173
1400399437,23cyclictest0-21swapper/320:45:283
1400299433,9cyclictest8050irq/56-dwc_otg_20:25:342
14001994314,9cyclictest0-21swapper/120:32:411
14000994316,13cyclictest0-21swapper/020:12:020
1400099431,24cyclictest0-21swapper/020:27:350
1400099431,23cyclictest0-21swapper/019:55:170
1400399423,22cyclictest0-21swapper/322:45:273
1400399422,15cyclictest7950irq/56-dwc_otg_21:45:463
14000994220,10cyclictest0-21swapper/020:31:290
14000994218,5cyclictest26700-21wget19:45:290
14000994213,20cyclictest0-21swapper/020:17:370
76642410,2sleep30-21swapper/300:09:563
66242411,36sleep36634-21ssh21:27:233
1400399417,24cyclictest0-21swapper/321:00:293
1400399417,24cyclictest0-21swapper/300:20:303
1400399413,25cyclictest7850irq/56-dwc_otg21:55:323
14003994113,6cyclictest7950irq/56-dwc_otg_22:30:473
14003994113,6cyclictest7950irq/56-dwc_otg_22:30:473
14003994113,5cyclictest17708-21aten_rbpower_po19:20:283
1400099418,21cyclictest0-21swapper/019:35:260
14000994114,14cyclictest0-21swapper/020:24:170
14000994114,14cyclictest0-21swapper/020:24:170
1400399407,16cyclictest8050irq/56-dwc_otg_19:10:443
1400399405,9cyclictest8406-21ssh21:30:253
14003994015,12cyclictest12946-21ssh21:35:383
1400399396,16cyclictest29068-21/usr/sbin/munin21:15:393
14003993924,5cyclictest3486-21idleruntime-cro22:05:163
1400399391,4cyclictest0-21swapper/323:00:273
1400299396,23cyclictest0-21swapper/220:20:282
1400299396,23cyclictest0-21swapper/220:20:282
1400399384,4cyclictest7850irq/56-dwc_otg23:35:293
1400399384,4cyclictest7850irq/56-dwc_otg23:35:293
1400399382,11cyclictest8050irq/56-dwc_otg_21:54:053
1400399381,23cyclictest21014-21latency_hist19:30:163
1400399376,14cyclictest8050irq/56-dwc_otg_00:25:363
1400399374,8cyclictest28217-21acpi23:55:283
1400399371,9cyclictest704950rm22:50:243
1400399371,9cyclictest704950rm22:50:243
14003993716,13cyclictest478-21ls20:00:423
1400399368,14cyclictest8050irq/56-dwc_otg_22:15:163
1400399363,10cyclictest0-21swapper/300:35:283
1400399362,10cyclictest14263-21cpuspeed20:40:293
14003993614,5cyclictest3039450wget19:55:283
1400299361,5cyclictest0-21swapper/219:44:562
1400299361,5cyclictest0-21swapper/219:44:562
1400299361,13cyclictest0-21swapper/220:54:452
1400399356,5cyclictest8050irq/56-dwc_otg_22:15:493
1400399353,20cyclictest0-21swapper/321:41:373
14003993512,5cyclictest496-21latency00:00:393
1400299352,8cyclictest8050irq/56-dwc_otg_20:55:272
1400399343,25cyclictest8050irq/56-dwc_otg_23:30:263
14003993420,4cyclictest8050irq/56-dwc_otg_23:05:453
14003993420,4cyclictest8050irq/56-dwc_otg_23:05:453
14003993410,5cyclictest0-21swapper/323:10:293
216712330,2sleep3381ktimersoftd/323:46:283
1400399338,6cyclictest8050irq/56-dwc_otg_23:50:333
1400399331,24cyclictest7798-21ls20:20:413
1400399331,24cyclictest7798-21ls20:20:413
1400399331,22cyclictest28774-21timerwakeupswit23:15:463
1400399331,22cyclictest0-21swapper/300:10:453
14003993310,10cyclictest0-21swapper/323:25:333
1400399326,6cyclictest0-21swapper/300:15:443
1400399326,13cyclictest8050irq/56-dwc_otg_23:20:353
1400399321,19cyclictest0-21swapper/320:40:163
1400399321,12cyclictest8050irq/56-dwc_otg_23:42:263
1400399317,13cyclictest0-21swapper/320:15:283
1400399314,5cyclictest10585-21aten_rbpower_vo20:30:303
1400399312,8cyclictest25560-21ntp_states19:40:383
1400399312,8cyclictest25560-21ntp_states19:40:383
1400399312,18cyclictest0-21swapper/319:19:103
1400399311,8cyclictest24206-21unixbench_singl19:35:443
1400399311,14cyclictest8050irq/56-dwc_otg_19:50:323
137282314,20sleep30-21swapper/319:10:143
1400399303,8cyclictest19910-21fschecks_time20:55:323
1400399302,5cyclictest7850irq/56-dwc_otg19:45:343
14003993010,6cyclictest0-21swapper/320:25:313
1400399291,17cyclictest0-21swapper/321:05:443
135512287,15sleep10-21swapper/119:07:541
136692274,15sleep20-21swapper/219:09:282
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional