You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-31 - 15:40

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #7, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack7slot3s.osadl.org (updated Fri Jul 31, 2026 12:43:47)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
24088991673,141cyclictest0-21swapper/009:25:280
240889913612,48cyclictest31390-21ssh11:45:380
24088991233,97cyclictest0-21swapper/010:15:380
24090991104,81cyclictest14689-21ssh09:25:262
24088991094,88cyclictest0-21swapper/012:30:450
240889910818,14cyclictest0-21swapper/009:25:290
240889910521,16cyclictest0-21swapper/011:26:440
24088991034,71cyclictest0-21swapper/008:50:560
360121010,2sleep10-21swapper/109:10:501
24091991012,7cyclictest7950irq/56-dwc_otg_10:15:373
24088991002,81cyclictest0-21swapper/012:05:420
24088991002,81cyclictest0-21swapper/012:05:420
1801421000,2sleep10-21swapper/109:29:071
24091999917,54cyclictest0-21swapper/311:45:363
2409099973,77cyclictest31361-21ssh11:45:372
2408899975,12cyclictest0-21swapper/010:14:200
24090999318,57cyclictest0-21swapper/210:15:432
2408899931,73cyclictest11004-21aten_rbpower_cu11:20:410
317832900,2sleep30-21swapper/310:25:483
2408899902,33cyclictest15417-21fschecks_time08:15:450
2409099893,9cyclictest0-21swapper/210:14:202
2408899897,66cyclictest0-21swapper/009:30:420
24088998912,20cyclictest13412-21aten_rbpower_po08:10:420
24090998711,68cyclictest0-21swapper/212:30:452
2409199844,13cyclictest509-21avahi-daemon12:30:473
2408899831,14cyclictest0-21swapper/010:25:570
2408899822,34cyclictest0-21swapper/012:25:020
2408899822,34cyclictest0-21swapper/012:25:020
2408899821,28cyclictest0-21swapper/010:56:430
2408899811,40cyclictest27054-21latency_hist09:40:280
279082800,2sleep30-21swapper/311:40:513
2408899801,27cyclictest11292-21aten_rbpower_vo12:00:410
2408899788,18cyclictest0-21swapper/009:45:270
2408899788,18cyclictest0-21swapper/009:45:270
2408899782,36cyclictest0-21swapper/010:46:020
2408899782,36cyclictest0-21swapper/010:46:020
2408899781,34cyclictest32486-21ssh09:45:580
81512770,6sleep18150-21users09:55:571
2409099772,32cyclictest0-21swapper/211:05:412
24088997720,12cyclictest11059-21aten_rbpower_en10:40:410
2408899771,61cyclictest18803-21latency_hist10:10:270
2409099761,58cyclictest28889-21unixbench_multi08:50:562
2408899761,5cyclictest3795-21wc10:30:550
24088997518,11cyclictest3304-21processes07:40:520
2408899751,33cyclictest0-21swapper/010:00:280
2408899751,28cyclictest0-21swapper/010:03:410
24091997321,6cyclictest25965-21/usr/sbin/munin08:45:503
2408899736,23cyclictest0-21swapper/009:12:240
2408899731,5cyclictest24025-21ntp_states11:35:500
24090997210,56cyclictest0-21swapper/209:25:292
2408899722,28cyclictest0-21swapper/008:02:200
2408899721,51cyclictest32120-21latency12:25:480
2408899721,35cyclictest0-21swapper/011:06:050
24088997211,3cyclictest0-21swapper/008:40:470
2409199715,12cyclictest8050irq/56-dwc_otg_11:26:443
2409199714,9cyclictest0-21swapper/309:25:293
2409099713,13cyclictest0-21swapper/211:26:412
2409099711,54cyclictest7950irq/56-dwc_otg_10:35:392
2408899712,21cyclictest27436-21awk11:00:430
2408899711,15cyclictest0-21swapper/011:41:590
2408899711,13cyclictest0-21swapper/010:20:590
2408899711,13cyclictest0-21swapper/010:20:590
116862710,2sleep20-21swapper/210:40:492
2409199706,8cyclictest0-21swapper/309:25:293
24090997011,42cyclictest31224-21latency_hist07:30:272
2408899701,29cyclictest0-21swapper/011:15:420
2408899701,28cyclictest0-21swapper/007:50:570
2408899701,15cyclictest0-21swapper/011:13:440
2409199683,9cyclictest0-21swapper/312:05:403
2409199683,9cyclictest0-21swapper/312:05:403
2409099683,6cyclictest0-21swapper/212:05:402
2409099683,6cyclictest0-21swapper/212:05:402
2408899681,32cyclictest0-21swapper/012:35:430
94532670,3sleep10-21swapper/111:57:571
2409099671,49cyclictest7139-21ssh11:55:392
24088996718,4cyclictest7850irq/56-dwc_otg11:55:410
2408899666,22cyclictest0-21swapper/009:00:410
2408899662,50cyclictest19639-21wc08:25:540
2408899662,41cyclictest24150-21wget07:10:410
2408899661,30cyclictest3006-21cpuspeed09:50:420
2408899661,28cyclictest0-21swapper/012:20:270
2409099658,46cyclictest7850irq/56-dwc_otg11:20:412
24090996513,40cyclictest29132-21sh11:41:592
2408999656,17cyclictest31380-21apt-get11:45:391
2409099645,47cyclictest23113-21sh09:35:402
2408999646,17cyclictest3530-21fschecks_time12:30:441
2408899642,31cyclictest0-21swapper/007:56:570
2409099636,42cyclictest3578-21ntp_states10:30:502
2409099628,40cyclictest0-21swapper/211:00:532
2409099625,45cyclictest8050irq/56-dwc_otg_10:05:552
2409099625,44cyclictest31230-21apt-config12:25:272
2409099625,44cyclictest31230-21apt-config12:25:272
2409099624,9cyclictest7850irq/56-dwc_otg10:29:562
2409099623,9cyclictest7950irq/56-dwc_otg_07:46:342
2409099622,45cyclictest0-21swapper/209:15:492
2409099622,11cyclictest0-21swapper/210:55:322
2409099622,10cyclictest0-21swapper/212:00:392
2408899625,37cyclictest20055-21ntp_kernel_err12:10:490
2408899622,37cyclictest0-21swapper/010:40:270
3962610,2sleep10-21swapper/111:06:301
2409099619,40cyclictest0-21swapper/211:10:472
2409099618,4cyclictest7950irq/56-dwc_otg_09:46:322
2409099616,8cyclictest8050irq/56-dwc_otg_11:15:412
2409099611,50cyclictest125-21systemd-journal12:30:262
2408899612,7cyclictest508-21latency_hist07:35:260
2409099602,45cyclictest0-21swapper/212:19:222
2409099601,46cyclictest0-21swapper/208:40:272
24088996028,6cyclictest0-21swapper/008:35:450
2408899602,39cyclictest19804-21wc10:50:490
2409099592,10cyclictest0-21swapper/211:36:402
2409099591,41cyclictest0-21swapper/212:35:462
2409099591,11cyclictest0-21swapper/210:21:532
2409099591,11cyclictest0-21swapper/210:21:532
24089995911,20cyclictest15282-21apt-get12:05:401
24089995911,20cyclictest15282-21apt-get12:05:401
24088995911,37cyclictest0-21swapper/008:45:510
2409099589,40cyclictest165392sleep208:18:262
2409099586,43cyclictest8050irq/56-dwc_otg_08:10:442
24090995816,38cyclictest15562-21if_wlan010:45:462
24090995816,38cyclictest15562-21if_wlan010:45:462
24090995811,35cyclictest3023-21latency07:40:472
2408899581,34cyclictest4423-21aten_rbpower_vo07:45:410
2408899581,31cyclictest0-21swapper/009:19:370
2409099572,46cyclictest7950irq/56-dwc_otg_12:11:222
2409099571,6cyclictest13222-21sh10:02:482
2409099571,5cyclictest20687-21ssh10:51:252
2409099571,11cyclictest27527-21fschecks_time09:40:442
2409099571,11cyclictest27527-21fschecks_time09:40:442
24089995710,19cyclictest7350-21sh12:35:401
2408899577,36cyclictest2995-21/usr/sbin/munin11:50:480
24088995737,9cyclictest101ktimersoftd/009:05:410
24088995716,3cyclictest8050irq/56-dwc_otg_11:30:390
2409199566,12cyclictest0-21swapper/309:00:413
2409099561,7cyclictest6737-21cat09:15:282
2409099561,45cyclictest0-21swapper/209:55:012
2409099561,15cyclictest0-21swapper/208:45:492
2409099561,10cyclictest181592sleep208:21:082
2408999568,9cyclictest7850irq/56-dwc_otg09:45:401
2408899561,38cyclictest30258-21ntpq08:55:500
2408899561,20cyclictest0-21swapper/007:20:500
2409099552,12cyclictest0-21swapper/211:50:352
2409099551,49cyclictest10785-21latency_hist10:00:282
2409199545,28cyclictest8050irq/56-dwc_otg_10:14:213
2409099542,7cyclictest19469-21cut11:30:432
24090995423,28cyclictest24494-21fschecks_time08:40:452
2408999548,8cyclictest7850irq/56-dwc_otg11:00:401
2408999543,14cyclictest14791-21taskset09:25:281
24089995413,14cyclictest0-21swapper/110:15:421
2408899542,34cyclictest0-21swapper/007:15:460
2408899542,34cyclictest0-21swapper/007:15:460
2408899541,36cyclictest0-21swapper/008:30:480
138652540,2sleep10-21swapper/112:03:281
24089995311,14cyclictest0-21swapper/110:14:221
2409099524,4cyclictest1263-21load07:35:472
2409099523,37cyclictest0-21swapper/207:56:592
2409099521,5cyclictest25910-21/usr/sbin/munin07:15:502
2409099521,5cyclictest25910-21/usr/sbin/munin07:15:502
2409099521,4cyclictest220652sleep208:34:572
2409099521,4cyclictest0-21swapper/207:35:262
2409099521,13cyclictest0-21swapper/209:30:332
24089995210,14cyclictest2372-21diskmemload11:26:411
2408899521,33cyclictest29579-21grep07:25:410
2409099513,6cyclictest0-21swapper/208:26:262
2408999517,28cyclictest0-21swapper/110:35:331
227042513,14sleep00-21swapper/007:05:490
2409099509,4cyclictest10765-21cat08:00:542
2409099505,37cyclictest7950irq/56-dwc_otg_08:07:412
2409099505,37cyclictest7950irq/56-dwc_otg_08:07:412
2409099501,5cyclictest27755-21cut07:20:412
24089995021,6cyclictest6743-21grep10:35:271
24089994912,8cyclictest10962-21ssh11:20:391
2409099481,9cyclictest0-21swapper/207:50:462
2409099481,8cyclictest25211-21grep07:10:562
2409099481,7cyclictest29868-21tune2fs08:55:442
2409099481,10cyclictest0-21swapper/209:04:402
2408899481,30cyclictest17708-21wc08:20:530
278962470,2sleep3381ktimersoftd/309:40:493
278962470,2sleep3381ktimersoftd/309:40:493
2409099461,7cyclictest8050irq/56-dwc_otg_09:07:382
2408999464,12cyclictest0-21swapper/110:25:381
2408899466,26cyclictest0-21swapper/008:05:420
2408899466,26cyclictest0-21swapper/008:05:420
2409199457,24cyclictest0-21swapper/307:50:423
2409199456,22cyclictest27779-21sshd08:50:403
24089994519,14cyclictest0-21swapper/111:35:391
2408899451,34cyclictest0-21swapper/007:35:440
2409199448,24cyclictest27233-21ssh11:00:423
2409199441,30cyclictest3470-21ls09:50:503
24089994418,6cyclictest8050irq/56-dwc_otg_08:10:401
2409199433,4cyclictest8050irq/56-dwc_otg_09:49:593
24091994217,15cyclictest7921-21rm12:35:483
2408999429,7cyclictest7850irq/56-dwc_otg10:55:401
24089994212,17cyclictest27524-21kworker/u8:409:40:371
24089994212,17cyclictest27524-21kworker/u8:409:40:371
24089994126,8cyclictest23-21ksoftirqd/112:10:381
2408999412,23cyclictest3343-21ssh09:50:481
24089994121,5cyclictest2783350wget08:50:411
2409199407,13cyclictest2744-21ssh09:10:323
24091994018,6cyclictest28539-21sh10:21:043
24091994018,6cyclictest28539-21sh10:21:043
2408999408,30cyclictest27184-21ssh10:20:411
2408999408,30cyclictest27184-21ssh10:20:411
2408999403,23cyclictest7950irq/56-dwc_otg_10:50:411
24089994014,15cyclictest23-21ksoftirqd/109:30:401
24089994010,28cyclictest0-21swapper/110:40:401
2408999398,29cyclictest0-21swapper/108:45:401
2408999397,8cyclictest7850irq/56-dwc_otg09:20:221
2408999392,5cyclictest0-21swapper/107:50:411
2409199381,3cyclictest7950irq/56-dwc_otg_11:35:383
24091993813,6cyclictest14719-21latency_hist11:25:273
2408999388,27cyclictest0-21swapper/108:35:401
2408999387,6cyclictest32515-21switchtime12:25:541
2409199373,6cyclictest8050irq/56-dwc_otg_08:20:573
2409199372,4cyclictest7950irq/56-dwc_otg_10:05:383
24091993714,14cyclictest122822chrt10:01:033
2408999379,26cyclictest0-21swapper/111:50:401
2408999379,16cyclictest8050irq/56-dwc_otg_09:35:531
2408999378,14cyclictest0-21swapper/112:15:501
2408999371,9cyclictest31237-21latency_hist12:25:271
2408999371,9cyclictest31237-21latency_hist12:25:271
2409199364,5cyclictest7950irq/56-dwc_otg_10:35:313
24091993619,6cyclictest31541-21/usr/sbin/munin12:25:473
2408999368,18cyclictest0-21swapper/108:40:401
2408999366,7cyclictest7850irq/56-dwc_otg08:15:561
2408999362,28cyclictest8050irq/56-dwc_otg_07:40:381
2408999362,11cyclictest0-21swapper/111:13:501
24089993612,5cyclictest0-21swapper/110:05:531
247662350,2sleep30-21swapper/308:40:493
2409199357,17cyclictest0-21swapper/309:30:423
2409199353,5cyclictest7950irq/56-dwc_otg_07:40:553
2409199352,4cyclictest8050irq/56-dwc_otg_10:34:403
2409199351,22cyclictest19291-21ls11:30:403
24091993510,10cyclictest7950irq/56-dwc_otg_11:05:503
24089993529,3cyclictest0-21swapper/107:10:281
24089993516,5cyclictest2372-21diskmemload11:41:361
2408999351,5cyclictest7850irq/56-dwc_otg08:00:551
2408999351,22cyclictest31691-21ls07:30:461
2408999351,20cyclictest7850irq/56-dwc_otg10:47:041
2408999351,20cyclictest7850irq/56-dwc_otg10:47:041
246822340,2sleep30-21swapper/309:36:263
2409199345,23cyclictest7109-21ssh11:55:383
2409199343,4cyclictest8050irq/56-dwc_otg_09:59:303
2409199343,4cyclictest0-21swapper/311:50:433
2409199341,7cyclictest8050irq/56-dwc_otg_12:20:533
2409199341,7cyclictest8050irq/56-dwc_otg_12:20:533
2409199341,7cyclictest20091-21ntp_states12:10:503
2409199341,7cyclictest13316-21/usr/sbin/munin08:10:563
2409199341,5cyclictest23603-21ssh12:15:443
24091993415,11cyclictest9329-21ssh09:18:023
24091993411,6cyclictest7777-21wc11:15:543
2409199341,16cyclictest0-21swapper/307:15:483
2409199341,16cyclictest0-21swapper/307:15:483
24091993411,12cyclictest0-21swapper/310:58:323
2408999342,8cyclictest0-21swapper/110:00:401
2408999342,26cyclictest8050irq/56-dwc_otg_07:45:391
2408999341,20cyclictest0-21swapper/107:15:401
2408999341,20cyclictest0-21swapper/107:15:401
24089993411,5cyclictest0-21swapper/111:19:191
24089993410,5cyclictest7850irq/56-dwc_otg08:30:261
2409199337,14cyclictest0-21swapper/308:05:423
2409199337,14cyclictest0-21swapper/308:05:423
2409199333,7cyclictest8050irq/56-dwc_otg_07:30:453
2409199332,7cyclictest11510-21ssh10:40:473
2409199331,7cyclictest22577-21diskstats08:35:433
2409199331,16cyclictest0-21swapper/310:45:483
2409199331,16cyclictest0-21swapper/310:45:483
2408999334,20cyclictest21-21rcuc/107:35:401
2408999332,20cyclictest0-21swapper/107:55:531
24089993314,12cyclictest19620-21taskset11:30:451
2409199328,5cyclictest7850irq/56-dwc_otg09:05:393
2409199327,5cyclictest8050irq/56-dwc_otg_11:15:263
2409199321,7cyclictest18745-21/usr/sbin/munin08:25:543
2409199321,5cyclictest11591-21ssh12:00:453
24091993211,5cyclictest0-21swapper/310:52:083
2408999327,16cyclictest0-21swapper/108:30:411
2408999322,7cyclictest11738-21df08:05:441
2408999322,7cyclictest11738-21df08:05:441
2408999321,4cyclictest7950irq/56-dwc_otg_07:20:461
2409199316,5cyclictest7950irq/56-dwc_otg_07:10:453
24091993124,5cyclictest381ktimersoftd/307:45:503
2408999314,5cyclictest0-21swapper/109:00:271
2408999311,22cyclictest0-21swapper/109:07:271
230472317,12sleep30-21swapper/307:05:563
2408999307,14cyclictest0-21swapper/108:20:411
229882304,12sleep20-21swapper/207:05:552
2409199294,4cyclictest7950irq/56-dwc_otg_08:15:543
24091992920,6cyclictest20596-21basename08:30:413
24091992920,6cyclictest10833-21unixbench_multi08:00:553
2408999292,4cyclictest7850irq/56-dwc_otg09:00:521
2408999291,6cyclictest0-21swapper/107:25:381
2409199283,8cyclictest39-21ksoftirqd/307:20:503
2409199282,5cyclictest8050irq/56-dwc_otg_09:00:013
2409199281,4cyclictest8050irq/56-dwc_otg_07:55:463
236032283,14sleep10-21swapper/107:07:401
24091992710,5cyclictest20132chrt07:37:253
2409199261,3cyclictest7850irq/56-dwc_otg07:25:553
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional