You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-06 - 13:02

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #7, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack7slot3s.osadl.org (updated Thu Aug 06, 2026 00:43:43)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2371324520,2sleep30-21swapper/319:05:573
24511991285,52cyclictest0-21swapper/023:25:460
245119912843,11cyclictest7950irq/56-dwc_otg_22:50:420
245179911111,24cyclictest7950irq/56-dwc_otg_22:10:491
24524991093,83cyclictest8050irq/56-dwc_otg_00:05:492
24511999916,60cyclictest0-21swapper/023:00:530
24524999510,61cyclictest0-21swapper/200:25:512
2452499949,11cyclictest18247-21df_inode23:25:452
24517999342,19cyclictest7850irq/56-dwc_otg21:16:041
24517999342,19cyclictest7850irq/56-dwc_otg21:16:041
24511999320,42cyclictest9-21ksoftirqd/021:16:020
24511999320,42cyclictest9-21ksoftirqd/021:16:020
24511999315,41cyclictest0-21swapper/023:21:000
24511999257,19cyclictest21185-21fschecks_count22:10:480
2452499903,16cyclictest0-21swapper/223:21:002
289882890,2sleep30-21swapper/300:17:363
289882890,2sleep30-21swapper/300:17:363
2451199893,60cyclictest9821-21sshd22:35:560
2452499886,11cyclictest0-21swapper/223:00:522
24517998850,11cyclictest3294-21sh00:25:511
24524998711,11cyclictest31-21ksoftirqd/221:16:042
24524998711,11cyclictest31-21ksoftirqd/221:16:042
2452499863,16cyclictest27138-21fschecks_time00:15:482
2452499863,16cyclictest27138-21fschecks_time00:15:482
2452499843,14cyclictest21219-21fschecks_time22:10:492
2452499842,18cyclictest7950irq/56-dwc_otg_21:30:482
2452499834,13cyclictest11697-21sh00:35:572
2452499834,10cyclictest0-21swapper/222:35:542
2451199836,14cyclictest0-21swapper/021:05:450
2451199832,35cyclictest0-21swapper/021:30:430
2451199823,58cyclictest0-21swapper/000:05:510
2451199802,44cyclictest26784-21ssh00:15:410
2451199802,44cyclictest26784-21ssh00:15:410
2452499795,10cyclictest0-21swapper/222:50:422
2451199793,57cyclictest0-21swapper/000:35:550
163572790,6sleep22452499cyclictest22:44:182
2452499773,15cyclictest4279-21apt-get21:50:432
24511997729,29cyclictest17423-21missed_timers22:05:510
24511997644,8cyclictest7850irq/56-dwc_otg21:50:440
2452499753,12cyclictest17394-21taskset22:05:512
250202740,1sleep00-21swapper/000:12:540
2451199746,42cyclictest0-21swapper/020:35:350
24517997339,14cyclictest7850irq/56-dwc_otg23:25:451
2451799733,58cyclictest20611-21grep21:30:481
24511997354,5cyclictest101ktimersoftd/000:25:450
139642720,2sleep00-21swapper/021:22:340
24517997022,22cyclictest221ktimersoftd/100:35:561
24531996917,17cyclictest37-21rcuc/323:25:443
2451199696,34cyclictest0-21swapper/020:25:430
24517996743,9cyclictest8050irq/56-dwc_otg_23:20:511
24517996713,33cyclictest0-21swapper/100:05:511
24531996617,11cyclictest39-21ksoftirqd/321:16:023
24531996617,11cyclictest39-21ksoftirqd/321:16:023
2451199662,47cyclictest0-21swapper/000:20:420
24531996510,30cyclictest39-21ksoftirqd/321:30:483
2451199641,43cyclictest9363-21latency_hist23:15:290
2451199641,31cyclictest0-21swapper/021:35:410
2452499634,5cyclictest7950irq/56-dwc_otg_19:45:482
2451199633,5cyclictest0-21swapper/021:55:450
2451199633,5cyclictest0-21swapper/021:55:450
24511996319,23cyclictest29668-21sh22:20:500
24511996319,23cyclictest29668-21sh22:20:500
85622620,3sleep337-21rcuc/323:14:073
2453199623,12cyclictest37-21rcuc/322:05:513
2452499623,13cyclictest25012-21fschecks_count20:40:462
2451799613,43cyclictest0-21swapper/100:15:561
2451799613,43cyclictest0-21swapper/100:15:561
2452499602,12cyclictest28596-21ssh22:20:122
2452499601,4cyclictest8050irq/56-dwc_otg_21:35:582
24517996027,18cyclictest7850irq/56-dwc_otg22:05:521
2451199605,37cyclictest0-21swapper/020:20:410
24511996027,27cyclictest0-21swapper/023:30:430
2451199601,44cyclictest6769-21grep00:30:450
2451199601,37cyclictest26344-21latency_hist20:45:290
24511995920,5cyclictest25291-21fschecks_count22:15:460
2451199591,29cyclictest12089-21aten_rbpower_en20:05:470
2453199584,32cyclictest0-21swapper/323:20:583
24531995810,25cyclictest7850irq/56-dwc_otg21:50:423
2452499583,6cyclictest8050irq/56-dwc_otg_20:45:572
2452499582,5cyclictest15913-21grep20:15:472
2452499581,5cyclictest7950irq/56-dwc_otg_00:14:152
2451799585,37cyclictest0-21swapper/121:50:421
2451199589,30cyclictest0-21swapper/020:50:570
24511995825,17cyclictest0-21swapper/019:40:300
40542570,2sleep229-21rcuc/223:47:152
40542570,2sleep229-21rcuc/223:47:152
2453199579,25cyclictest2114750ssh22:10:483
2453199577,26cyclictest3255-21runrttasks00:25:513
2452499574,4cyclictest7850irq/56-dwc_otg23:05:562
2452499572,14cyclictest0-21swapper/219:59:452
24524995711,4cyclictest0-21swapper/200:30:522
24511995728,19cyclictest0-21swapper/019:10:420
2452499563,3cyclictest8050irq/56-dwc_otg_19:10:442
2452499561,12cyclictest7950irq/56-dwc_otg_21:13:482
24511995640,7cyclictest7950irq/56-dwc_otg_19:15:430
24511995630,5cyclictest7850irq/56-dwc_otg22:25:560
24511995616,21cyclictest1518-21wget23:05:430
24531995520,21cyclictest37-21rcuc/300:35:543
2452499552,11cyclictest0-21swapper/220:51:262
24524995520,32cyclictest11805-21ssh23:17:292
2452499551,7cyclictest727-21runrttasks23:50:522
2452499551,6cyclictest17350-21/usr/sbin/munin22:45:422
24524995516,5cyclictest1914-21ssh21:46:462
24524995516,5cyclictest1914-21ssh21:46:462
24524995510,4cyclictest0-21swapper/223:12:422
2451799556,23cyclictest7950irq/56-dwc_otg_23:00:531
24511995525,4cyclictest0-21swapper/020:30:410
2451199552,38cyclictest14905-21unixbench-2d20:10:570
2451199551,31cyclictest6500-21taskset23:50:470
2453199545,26cyclictest11-21rcu_preempt22:50:433
2452499547,3cyclictest0-21swapper/221:45:262
2451799546,18cyclictest7950irq/56-dwc_otg_19:55:431
2451199542,31cyclictest0-21swapper/019:41:010
2451199542,31cyclictest0-21swapper/019:41:010
24511995422,17cyclictest7950irq/56-dwc_otg_21:10:500
2451199541,31cyclictest30372-21runrttasks23:40:420
2452499538,3cyclictest0-21swapper/223:39:492
2452499534,10cyclictest0-21swapper/223:42:392
2452499532,12cyclictest7950irq/56-dwc_otg_19:53:572
2452499531,7cyclictest13440-21ntp_states22:00:542
2452499531,6cyclictest1986-21ssh00:25:022
2451799533,34cyclictest0-21swapper/122:50:411
2451199531,31cyclictest32119-21fschecks_time19:30:460
24531995211,25cyclictest0-21swapper/323:00:533
2452499526,4cyclictest8050irq/56-dwc_otg_22:59:532
2451799522,8cyclictest0-21swapper/123:35:421
24511995232,5cyclictest8050irq/56-dwc_otg_23:45:420
24511995232,5cyclictest8050irq/56-dwc_otg_23:45:420
2451199521,28cyclictest13270-21aten_rbpower_cu22:40:420
2451199521,25cyclictest32622-21ssh21:45:440
2451199521,25cyclictest32622-21ssh21:45:440
2453199518,11cyclictest9815-21ssh22:35:553
2453199512,8cyclictest7850irq/56-dwc_otg20:40:413
2452499516,11cyclictest7950irq/56-dwc_otg_21:05:122
2452499511,5cyclictest13818-21/usr/sbin/munin20:10:402
2451199513,29cyclictest0-21swapper/020:05:300
24511995110,30cyclictest0-21swapper/022:04:550
2452499505,4cyclictest0-21swapper/222:32:042
2452499501,14cyclictest0-21swapper/222:25:472
2451799504,20cyclictest7850irq/56-dwc_otg22:30:431
24511995030,7cyclictest8050irq/56-dwc_otg_20:55:580
24511995026,3cyclictest0-21swapper/019:45:540
24511995025,12cyclictest0-21swapper/019:25:560
2451199501,31cyclictest17637-21/usr/sbin/munin22:45:480
2451199501,28cyclictest6642-21wget19:50:460
2451199501,26cyclictest15636-21grep00:00:590
109612500,3sleep339-21ksoftirqd/321:58:053
109612500,3sleep339-21ksoftirqd/321:58:053
2453199495,32cyclictest8050irq/56-dwc_otg_23:30:433
2453199494,8cyclictest0-21swapper/300:05:513
24524994910,4cyclictest0-21swapper/221:58:262
24524994910,4cyclictest0-21swapper/221:58:262
2451199496,22cyclictest0-21swapper/023:35:580
2451199492,3cyclictest0-21swapper/022:55:560
2451199492,22cyclictest0-21swapper/022:35:300
2451199491,5cyclictest11031-21ntpq23:55:520
2452499487,26cyclictest0-21swapper/219:35:412
2452499482,8cyclictest0-21swapper/220:20:412
2451799483,15cyclictest9808-21ssh22:35:551
2388924829,12sleep00-21swapper/019:06:280
309672470,8sleep0101ktimersoftd/021:43:080
2451799477,26cyclictest0-21swapper/120:50:421
24511994715,4cyclictest16144-21latency20:15:500
2451199471,28cyclictest11026-21ssh23:16:030
2451199471,25cyclictest16017-21apt-get21:25:430
2453199462,5cyclictest8050irq/56-dwc_otg_23:40:423
2451799468,10cyclictest7850irq/56-dwc_otg22:55:431
2451799467,25cyclictest0-21swapper/120:05:461
2451799467,24cyclictest0-21swapper/120:45:421
24511994624,5cyclictest7950irq/56-dwc_otg_21:00:550
2453199457,23cyclictest0-21swapper/320:50:423
2451799452,9cyclictest8050irq/56-dwc_otg_19:40:301
2452499447,24cyclictest0-21swapper/220:35:352
2452499443,26cyclictest0-21swapper/220:05:442
24524994421,5cyclictest19858-21latency_hist21:30:302
2451799447,23cyclictest0-21swapper/119:20:421
2451799446,5cyclictest0-21swapper/100:00:421
2451199446,7cyclictest0-21swapper/020:45:420
2451799437,26cyclictest0-21swapper/122:00:441
2451799437,22cyclictest0-21swapper/121:00:421
2451199431,29cyclictest0-21swapper/019:55:410
24531994216,5cyclictest32331-21ls19:30:483
2451799423,8cyclictest23-21ksoftirqd/123:30:421
2451799421,9cyclictest7950irq/56-dwc_otg_22:25:411
327342410,2sleep124504-21cyclictest23:42:551
2453199417,23cyclictest0-21swapper/319:10:363
2451799417,25cyclictest0-21swapper/120:55:351
2451799417,22cyclictest0-21swapper/119:25:431
2451799413,4cyclictest8050irq/56-dwc_otg_19:15:451
2451199411,6cyclictest29386-21grep19:20:570
2453199407,24cyclictest0-21swapper/320:45:423
2453199401,24cyclictest7850irq/56-dwc_otg22:25:303
2453199401,24cyclictest7850irq/56-dwc_otg22:25:303
2451799408,22cyclictest0-21swapper/120:10:431
2451799407,24cyclictest0-21swapper/121:25:351
2451799407,22cyclictest0-21swapper/119:10:431
24517994022,5cyclictest565150wget23:10:441
24517994010,5cyclictest23-21ksoftirqd/100:30:441
42862390,6sleep32453199cyclictest23:47:403
42862390,6sleep32453199cyclictest23:47:403
2453199396,24cyclictest29615-21ls21:40:583
2453199395,23cyclictest13715-21ls22:00:573
2453199391,4cyclictest8050irq/56-dwc_otg_22:45:573
2452499394,16cyclictest7950irq/56-dwc_otg_22:20:472
2452499394,16cyclictest7950irq/56-dwc_otg_22:20:472
2452499391,8cyclictest8050irq/56-dwc_otg_19:30:422
2451799395,24cyclictest3030-21diskmemload00:20:541
24517993915,4cyclictest25868-21ssh21:36:191
2451799387,22cyclictest0-21swapper/119:45:421
24517993827,4cyclictest8050irq/56-dwc_otg_23:05:551
24517993811,12cyclictest9650irq/80-mmc021:50:311
24517993811,12cyclictest9650irq/80-mmc021:50:311
2453199377,25cyclictest0-21swapper/323:15:423
2453199371,32cyclictest19978-21latency_hist21:30:303
2451799379,9cyclictest7850irq/56-dwc_otg21:10:501
2451799377,25cyclictest0-21swapper/120:15:431
2451799377,23cyclictest0-21swapper/122:40:421
2451799373,6cyclictest21-21rcuc/121:24:441
2451799372,8cyclictest8050irq/56-dwc_otg_21:55:451
2451799372,8cyclictest8050irq/56-dwc_otg_21:55:451
2451799371,4cyclictest0-21swapper/121:05:511
24517993711,15cyclictest125-21systemd-journal20:00:471
236222370,6sleep123568-21ssh00:10:541
24531993625,7cyclictest2897-21sshd23:06:173
2453199361,5cyclictest7850irq/56-dwc_otg19:35:463
2453199361,17cyclictest0-21swapper/322:20:303
2452499368,5cyclictest8050irq/56-dwc_otg_20:35:302
2452499362,8cyclictest10659-21fschecks_time23:55:472
2452499362,7cyclictest0-21swapper/221:05:442
2452499361,9cyclictest20984-21date20:30:302
2451799365,21cyclictest28502-21ssh21:40:441
2451799364,6cyclictest0-21swapper/123:45:401
2451799364,6cyclictest0-21swapper/123:45:401
2451799363,8cyclictest6914-21ntpq23:50:521
2451799362,24cyclictest19623-21ssh22:47:441
24517993612,17cyclictest21061-21runrttasks20:30:421
24517993612,12cyclictest0-21swapper/123:15:421
102342360,2sleep30-21swapper/323:55:383
24517993524,8cyclictest29424-21fschecks_time22:20:471
24517993524,8cyclictest29424-21fschecks_time22:20:471
176412351,5sleep117659-21df_inode20:20:451
2453199346,15cyclictest0-21swapper/320:55:363
2453199342,17cyclictest32151-21grep00:20:593
24531993413,13cyclictest6423-21sh21:13:593
2452499345,13cyclictest1692-21kworker/u8:100:00:522
2452499344,18cyclictest22506-21ssh23:30:482
24524993424,6cyclictest301ktimersoftd/219:25:432
2452499341,21cyclictest28748-21ls19:20:482
2453199335,4cyclictest7850irq/56-dwc_otg19:15:473
2453199333,7cyclictest7850irq/56-dwc_otg21:20:523
24531993314,5cyclictest8050irq/56-dwc_otg_23:54:073
2453199331,19cyclictest0-21swapper/321:40:303
24531993310,6cyclictest26620-21fschecks_time23:35:483
2452499337,4cyclictest0-21swapper/221:25:292
2452499333,15cyclictest0-21swapper/219:15:562
2451799334,13cyclictest7950irq/56-dwc_otg_20:45:301
2451799333,6cyclictest7725-21unixbench_multi19:51:001
2451799331,22cyclictest0-21swapper/120:35:351
2453199329,12cyclictest0-21swapper/300:02:513
2453199327,4cyclictest8050irq/56-dwc_otg_20:05:483
2453199325,5cyclictest7850irq/56-dwc_otg21:45:443
2453199325,5cyclictest7850irq/56-dwc_otg21:45:443
24531993220,5cyclictest22622-21apt-get20:35:303
2453199321,5cyclictest8050irq/56-dwc_otg_22:40:403
2453199321,3cyclictest8050irq/56-dwc_otg_22:28:183
2451799322,9cyclictest8050irq/56-dwc_otg_23:58:231
2451799322,7cyclictest24527-21mktemp19:10:311
2451799322,14cyclictest21-21rcuc/122:17:101
2453199319,5cyclictest7950irq/56-dwc_otg_00:10:453
2453199312,5cyclictest7395-21processes19:50:573
24531993110,4cyclictest0-21swapper/322:31:223
2451799314,13cyclictest21-21rcuc/119:43:131
2451799314,13cyclictest21-21rcuc/119:43:131
2451799311,18cyclictest7850irq/56-dwc_otg19:30:471
24531993024,4cyclictest381ktimersoftd/300:30:433
2453199301,5cyclictest0-21swapper/322:55:503
2453199301,14cyclictest8050irq/56-dwc_otg_20:15:303
2451799305,7cyclictest8050irq/56-dwc_otg_20:25:571
2453199291,18cyclictest8050irq/56-dwc_otg_20:00:473
2453199291,16cyclictest5212-21/usr/sbin/munin19:45:483
2453199291,16cyclictest19740-21latency20:25:503
2453199291,11cyclictest8050irq/56-dwc_otg_20:15:503
2452499296,5cyclictest3680-21ntp_kernel_pll_19:40:562
2452499296,5cyclictest3680-21ntp_kernel_pll_19:40:562
2452499293,5cyclictest7950irq/56-dwc_otg_20:55:502
2453199286,5cyclictest7950irq/56-dwc_otg_20:20:553
24531992820,6cyclictest1697-21fschecks_count21:05:483
2453199281,18cyclictest0-21swapper/319:57:153
2452499282,15cyclictest0-21swapper/220:04:392
2453199273,15cyclictest0-21swapper/319:44:233
2453199273,15cyclictest0-21swapper/319:44:233
2453199273,11cyclictest8050irq/56-dwc_otg_21:04:403
2453199271,6cyclictest0-21swapper/319:20:393
2452499271,7cyclictest24504-21cyclictest19:10:312
2453199268,4cyclictest0-21swapper/319:25:483
24531992620,4cyclictest22973-21aten_rbpower_cu20:35:433
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional