You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-16 - 05:02

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #7, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack7slot3s.osadl.org (updated Thu Apr 16, 2026 00:43:37)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2227622720,2sleep00-21swapper/004:25:590
2221421130,9sleep1221ktimersoftd/104:25:561
2328621040,5sleep229-21rcuc/204:26:132
1026521020,2sleep30-21swapper/309:13:433
2404099895,75cyclictest4365-21switchtime09:06:090
2404099895,75cyclictest4365-21switchtime09:06:090
24041998535,24cyclictest9535-21apt-get07:55:491
24040998324,13cyclictest7950irq/56-dwc_otg_07:56:010
24040998126,5cyclictest4044-21unixbench-2d06:31:110
24040997825,5cyclictest7850irq/56-dwc_otg_09:31:110
2404099771,5cyclictest8335-21ssh09:50:580
15572770,2sleep00-21swapper/008:24:450
248062760,5sleep22404299cyclictest08:13:072
2404199769,53cyclictest0-21swapper/109:50:591
2404099761,31cyclictest21105-21idleruntime05:51:020
294372740,1sleep30-21swapper/308:19:003
294372740,1sleep30-21swapper/308:19:003
24040997412,5cyclictest0-21swapper/006:15:580
105722740,1sleep20-21swapper/209:52:562
2404099731,31cyclictest5003-21fschecks_count07:10:590
24041997127,13cyclictest3616-21ssh07:47:301
24041997037,12cyclictest10317-21/usr/sbin/munin05:21:021
24041997037,12cyclictest10317-21/usr/sbin/munin05:21:021
24041997034,33cyclictest163150ssh09:03:071
2404099681,31cyclictest11428-21ssh06:40:560
24041996732,23cyclictest13768-21ssh08:38:551
24041996732,23cyclictest13768-21ssh08:38:551
24041996635,19cyclictest17049-21ssh08:04:071
24041996635,16cyclictest17802-21ssh06:47:341
24041996632,17cyclictest14970-21ssh09:19:451
24041996626,11cyclictest30981-21ssh08:21:011
24041996624,11cyclictest28450-21sh07:00:481
24041996622,14cyclictest27175-21ssh07:36:301
24041996536,15cyclictest28368-21ntp_offset04:41:051
24041996532,18cyclictest9098-21ssh09:11:371
24041996529,12cyclictest26261-21basename08:15:441
24041996528,12cyclictest19222-21/usr/sbin/munin08:46:051
24041996527,16cyclictest10113-21ssh06:39:051
24041996525,24cyclictest14081-21ssh09:56:461
24041996524,12cyclictest15277-21ssh07:22:411
2404099659,37cyclictest0-21swapper/007:26:120
24041996432,18cyclictest10056-21ssh08:34:561
24041996431,16cyclictest8241-21cpuspeed05:15:581
24041996429,15cyclictest28405-21cat07:00:451
24041996429,14cyclictest3214-21ssh09:44:371
24041996426,12cyclictest7908-21ssh07:14:261
24041996423,13cyclictest21628-21cpu07:30:581
2404099644,28cyclictest12224-21grep08:36:130
2404099644,28cyclictest12224-21grep08:36:130
185782640,2sleep00-21swapper/008:06:010
24041996335,12cyclictest22301-21ssh06:52:571
24041996334,13cyclictest25539-21ssh09:31:191
24041996333,12cyclictest20178-21ssh08:07:171
24041996331,17cyclictest29150-21ssh08:18:291
24041996331,17cyclictest29150-21ssh08:18:291
24041996328,22cyclictest19003-21ssh09:24:331
24041996321,10cyclictest0-21swapper/104:46:031
2404099632,35cyclictest1348-21wc07:45:450
2404099631,54cyclictest0-21swapper/007:52:380
2404299626,21cyclictest0-21swapper/206:20:572
24041996235,18cyclictest7540-21ssh09:49:581
24041996229,13cyclictest17583-21ssh08:43:191
24041996227,12cyclictest3102-21ssh06:30:591
24041996224,17cyclictest23608-21grep05:56:111
2404299616,18cyclictest26589-21ssh08:15:562
2404299616,18cyclictest26589-21ssh08:15:562
24041996131,18cyclictest11029-21ssh07:17:321
24041996130,16cyclictest2513-21diskmemload09:36:331
24041996130,16cyclictest2513-21diskmemload09:36:331
24041996128,16cyclictest26644-21ssh08:54:421
24041996123,19cyclictest0-21swapper/109:06:031
24041996123,19cyclictest0-21swapper/109:06:031
323952600,3sleep032333-21ssh09:01:040
24041996027,14cyclictest13066-21ssh06:41:471
24041996026,22cyclictest1660-21ssh07:06:121
24041996024,22cyclictest19729-21ssh07:28:141
24040996032,6cyclictest7850irq/56-dwc_otg_08:11:040
24040996020,26cyclictest7950irq/56-dwc_otg_09:00:440
24041995927,13cyclictest31620-21ssh07:42:001
24041995923,12cyclictest29423-21ssh08:57:121
179882590,3sleep10-21swapper/105:41:091
24041995830,12cyclictest4118-21ssh08:26:521
24041995824,12cyclictest27462-21modprobe04:40:431
2404399572,11cyclictest0-21swapper/309:55:553
2404099572,40cyclictest0-21swapper/005:06:040
24040995715,5cyclictest20496-21unixbench_singl08:46:110
24040995712,23cyclictest10990-21grep05:21:110
24040995712,23cyclictest10990-21grep05:21:110
67452560,2sleep00-21swapper/008:30:570
63372560,2sleep0101ktimersoftd/009:47:460
24041995630,10cyclictest916-21sshd06:25:531
24041995627,11cyclictest25667-21date04:35:441
24041995626,17cyclictest2513-21diskmemload07:55:011
2404099567,35cyclictest0-21swapper/008:16:020
2404099567,35cyclictest0-21swapper/008:16:020
2404099562,41cyclictest0-21swapper/009:27:010
2404099562,40cyclictest0-21swapper/009:36:010
2404099562,40cyclictest0-21swapper/009:36:010
2404099561,47cyclictest25198-21grep04:31:110
24040995613,12cyclictest0-21swapper/009:55:550
2404299557,6cyclictest0-21swapper/209:20:532
24041995523,20cyclictest7950irq/56-dwc_otg_05:50:571
24041995522,9cyclictest7950irq/56-dwc_otg_05:15:441
24041995522,14cyclictest22375-21ssh09:28:091
2404099554,23cyclictest0-21swapper/008:26:120
24040995537,4cyclictest6335-21aten_rbpower_en05:10:560
24040995527,12cyclictest7750irq/56-dwc_otg07:36:510
2404099552,28cyclictest0-21swapper/009:16:050
2404099551,39cyclictest9123-21cut07:15:580
2404099551,37cyclictest15954-21proc_pri08:41:080
2404099551,25cyclictest458-21ssh09:41:030
24041995423,11cyclictest20474-21chrt05:50:311
24041995423,10cyclictest0-21swapper/105:04:491
24041995421,19cyclictest25805-21taskset06:04:231
2404099542,39cyclictest13339-21latency_hist05:30:440
2404099542,39cyclictest0-21swapper/007:23:380
2404099542,37cyclictest0-21swapper/008:51:080
192782540,2sleep30-21swapper/309:25:033
24041995330,11cyclictest14786-21chrt05:32:081
24041995326,10cyclictest0-21swapper/106:09:201
24041995324,11cyclictest12926-21taskset05:26:261
24041995323,11cyclictest0-21swapper/106:22:501
24041995321,12cyclictest2203-21runrttasks04:59:261
24041995321,12cyclictest2203-21runrttasks04:59:261
24040995326,12cyclictest0-21swapper/006:36:040
24040995323,5cyclictest2345-21latency_hist05:00:430
24040995323,5cyclictest2345-21latency_hist05:00:430
2404099531,44cyclictest0-21swapper/005:15:570
2404099531,42cyclictest0-21swapper/006:45:570
2404299522,18cyclictest0-21swapper/205:05:552
24040995232,5cyclictest7850irq/56-dwc_otg_09:21:050
2404099521,36cyclictest8845-21unixbench_singl09:11:120
24042995128,10cyclictest7850irq/56-dwc_otg_07:20:002
24041995132,16cyclictest28243-21grep06:11:001
24041995132,16cyclictest28243-21grep06:11:001
24041995124,13cyclictest5975-21taskset05:10:101
24040995128,6cyclictest7850irq/56-dwc_otg_07:10:440
24040995127,6cyclictest7850irq/56-dwc_otg_06:11:110
24040995127,6cyclictest7850irq/56-dwc_otg_06:11:110
24040995124,5cyclictest0-21swapper/005:30:580
2404099512,35cyclictest0-21swapper/005:41:560
2404099512,34cyclictest0-21swapper/006:51:120
2404099511,32cyclictest24606-21fschecks_count06:01:000
2404099511,26cyclictest28752-21/usr/sbin/munin07:00:580
2404399501,11cyclictest7950irq/56-dwc_otg_06:50:553
2404299503,5cyclictest7750irq/56-dwc_otg04:50:552
24041995023,9cyclictest0-21swapper/105:37:081
2404099502,37cyclictest0-21swapper/007:46:330
2404099502,31cyclictest14244-21wget08:00:570
2404299498,23cyclictest18434-21resolvconf05:42:322
24042994925,9cyclictest7950irq/56-dwc_otg_09:31:042
24041994932,13cyclictest31047-21apt-get04:50:491
24041994919,12cyclictest0-21swapper/106:17:261
24040994933,6cyclictest7950irq/56-dwc_otg_06:56:050
2404099493,10cyclictest0-21swapper/005:36:120
2404099491,36cyclictest0-21swapper/007:31:500
2404299482,16cyclictest0-21swapper/207:40:542
2404099483,36cyclictest0-21swapper/005:46:120
24040994818,6cyclictest29247-21cron04:45:430
2404099481,43cyclictest31845-21uname04:51:030
2404099481,33cyclictest0-21swapper/004:50:390
24042994721,9cyclictest7950irq/56-dwc_otg_04:41:062
24042994712,23cyclictest301ktimersoftd/208:49:112
2404099472,34cyclictest0-21swapper/006:26:050
2404399462,9cyclictest0-21swapper/307:10:533
2404299467,24cyclictest0-21swapper/204:30:572
2404099462,34cyclictest0-21swapper/005:01:030
2404099457,35cyclictest0-21swapper/004:36:040
2404099452,32cyclictest0-21swapper/006:21:130
24040994510,8cyclictest0-21swapper/005:55:560
2404299447,25cyclictest0-21swapper/207:35:512
2404299443,7cyclictest0-21swapper/204:35:542
24042994416,8cyclictest7950irq/56-dwc_otg_06:44:572
2404099441,31cyclictest27258-21tail06:06:110
2404399437,22cyclictest0-21swapper/305:30:573
2404399431,7cyclictest7850irq/56-dwc_otg_08:00:533
2404299438,26cyclictest0-21swapper/208:20:582
2404299437,25cyclictest0-21swapper/205:00:572
2404299437,24cyclictest0-21swapper/207:10:512
24042994313,13cyclictest301ktimersoftd/207:55:502
24042994312,13cyclictest7950irq/56-dwc_otg_07:01:122
2404299429,20cyclictest23076-21ssh09:29:252
2404299427,24cyclictest0-21swapper/205:30:572
24042994221,8cyclictest7950irq/56-dwc_otg_09:06:022
24042994221,8cyclictest7950irq/56-dwc_otg_09:06:022
24042994220,9cyclictest7950irq/56-dwc_otg_05:16:012
24042994219,9cyclictest7950irq/56-dwc_otg_07:06:062
24042994217,7cyclictest7750irq/56-dwc_otg08:59:582
24042994216,12cyclictest7950irq/56-dwc_otg_05:21:012
24042994216,12cyclictest7950irq/56-dwc_otg_05:21:012
257552410,2sleep30-21swapper/309:31:433
2404399414,6cyclictest7950irq/56-dwc_otg_08:40:553
2404299417,24cyclictest0-21swapper/209:45:572
2404299416,8cyclictest15101-21apt-get08:40:562
24042994119,9cyclictest7850irq/56-dwc_otg_06:53:022
24042994116,12cyclictest7850irq/56-dwc_otg_08:32:122
2404299411,25cyclictest0-21swapper/205:35:572
2404399401,7cyclictest7950irq/56-dwc_otg_08:05:553
2404299404,19cyclictest0-21swapper/206:33:412
24042994014,13cyclictest7850irq/56-dwc_otg_06:55:462
24043993911,6cyclictest31142-21unixbench_singl07:41:113
24042993913,11cyclictest7750irq/56-dwc_otg06:47:392
2404299391,28cyclictest24597-21cut06:01:002
2404299391,28cyclictest19294-21ls05:46:022
2404299391,23cyclictest0-21swapper/206:10:572
2404299391,23cyclictest0-21swapper/206:10:572
98602380,2sleep30-21swapper/307:55:453
71062380,10sleep3381ktimersoftd/306:35:543
2404299385,15cyclictest7950irq/56-dwc_otg_08:10:102
24042993818,8cyclictest7950irq/56-dwc_otg_08:04:152
24042993817,7cyclictest7850irq/56-dwc_otg_09:11:192
24042993813,7cyclictest25577-21systemd-journal07:26:002
2404399378,4cyclictest0-21swapper/309:29:073
2404399371,21cyclictest15837-21latency05:36:043
2404299376,14cyclictest0-21swapper/205:50:552
24042993721,4cyclictest7950irq/56-dwc_otg_04:46:072
24042993720,7cyclictest7850irq/56-dwc_otg_08:29:192
24042993720,4cyclictest12439-21/usr/sbin/munin09:56:082
24042993717,9cyclictest7950irq/56-dwc_otg_08:52:012
24042993715,5cyclictest32287-21latency_hist09:40:452
24042993715,5cyclictest32287-21latency_hist09:40:452
2404299371,19cyclictest12229-21ssh09:16:042
24043993613,4cyclictest28458-21sensors08:56:083
24043993611,5cyclictest0-21swapper/309:45:443
2404299368,10cyclictest7850irq/56-dwc_otg_07:31:012
2404299366,22cyclictest0-21swapper/206:05:562
2404299363,14cyclictest0-21swapper/205:55:552
24042993616,4cyclictest7850irq/56-dwc_otg_07:50:172
24042993616,10cyclictest7850irq/56-dwc_otg_09:03:132
2404299361,18cyclictest7950irq/56-dwc_otg_05:15:442
24042993610,14cyclictest7850irq/56-dwc_otg_09:42:412
2404399359,10cyclictest0-21swapper/308:50:583
2404399355,6cyclictest7850irq/56-dwc_otg_09:05:553
2404399355,6cyclictest7850irq/56-dwc_otg_09:05:553
2404399354,4cyclictest7850irq/56-dwc_otg_09:35:543
2404399354,4cyclictest7850irq/56-dwc_otg_09:35:543
24043993519,5cyclictest908-21runrttasks05:40:543
24043993519,4cyclictest10977-21aten_rbpower_cu08:35:573
24043993519,4cyclictest10977-21aten_rbpower_cu08:35:573
24043993512,10cyclictest2067-21ssh08:25:423
2404299353,15cyclictest7950irq/56-dwc_otg_08:36:052
2404299353,15cyclictest7950irq/56-dwc_otg_08:36:052
2404299351,5cyclictest13654-21irqstats07:21:032
2404299351,16cyclictest7950irq/56-dwc_otg_05:25:582
270862340,1sleep30-21swapper/307:36:213
2404399349,16cyclictest0-21swapper/309:49:493
2404399348,6cyclictest0-21swapper/306:45:443
2404399344,9cyclictest7850irq/56-dwc_otg_05:13:413
2404399344,24cyclictest25011-21timerandwakeup04:31:103
24043993416,5cyclictest908-21runrttasks07:46:543
2404399341,23cyclictest12369-21missed_timers09:16:053
2404299347,12cyclictest7950irq/56-dwc_otg_07:53:042
2404299346,24cyclictest0-21swapper/206:25:582
2404299344,23cyclictest7950irq/56-dwc_otg_06:15:582
24042993416,7cyclictest7750irq/56-dwc_otg06:39:092
227892345,16sleep30-21swapper/304:26:073
2404399338,11cyclictest7950irq/56-dwc_otg_08:26:023
24043993315,6cyclictest6260-21apt-get08:30:453
24043993314,4cyclictest28010-21basename06:10:573
24043993314,4cyclictest28010-21basename06:10:573
2404399331,26cyclictest32430-21ls06:21:103
2404399331,23cyclictest6837-21ls07:51:123
2404399331,22cyclictest32023-21uniq09:01:003
24043993310,6cyclictest7850irq/56-dwc_otg_07:20:443
2404299339,8cyclictest7950irq/56-dwc_otg_04:59:522
2404299339,8cyclictest7950irq/56-dwc_otg_04:59:522
2404399329,4cyclictest7950irq/56-dwc_otg_07:31:093
24043993220,9cyclictest20317-21ssh08:46:103
24043993213,4cyclictest2513-21diskmemload09:51:003
2404399321,12cyclictest0-21swapper/306:46:123
2404399319,5cyclictest293550wget06:30:573
2404399316,20cyclictest30007-21cut06:16:013
2404399312,8cyclictest0-21swapper/307:01:083
2404399312,13cyclictest7950irq/56-dwc_otg_06:56:423
2404399312,12cyclictest7950irq/56-dwc_otg_05:46:293
24043993115,4cyclictest908-21runrttasks08:13:053
2404399311,20cyclictest26028-21cpuspeed04:35:583
2404399304,3cyclictest7750irq/56-dwc_otg07:21:543
2404399303,13cyclictest7950irq/56-dwc_otg_06:06:093
24043993013,6cyclictest39-21ksoftirqd/305:20:543
24043993013,6cyclictest39-21ksoftirqd/305:20:543
24043993010,4cyclictest21797-21ls05:51:123
2404399294,10cyclictest7950irq/56-dwc_otg_04:51:083
2404399293,10cyclictest0-21swapper/307:26:083
2404399292,10cyclictest0-21swapper/304:42:323
24043992910,6cyclictest1339-21switchtime07:06:103
2404399282,4cyclictest7850irq/56-dwc_otg_05:05:573
2404399281,17cyclictest1959-21timerwakeupswit06:26:133
2404399272,11cyclictest7950irq/56-dwc_otg_05:16:113
2404399271,4cyclictest7750irq/56-dwc_otg05:55:553
2404399262,8cyclictest0-21swapper/304:58:043
2404399262,8cyclictest0-21swapper/304:58:043
2404399255,5cyclictest7950irq/56-dwc_otg_05:25:563
2404399254,7cyclictest24409-21/usr/sbin/munin06:00:573
24043992517,5cyclictest520-21cron05:05:433
2404399251,14cyclictest0-21swapper/304:46:013
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional