You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-23 - 04:14

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack5slot4s.osadl.org (updated Wed Sep 23, 2026 00:44:12)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
338780121920,2sleep3481ktimers/322:10:003
32980722540,5sleep3481ktimers/320:39:113
3206998995243,6cyclictest3437222-21latency_hist23:00:010
3206998995144,5cyclictest3442678-21/usr/sbin/munin23:09:140
3206998995039,9cyclictest278-21systemd-journal00:25:000
3207005994944,4cyclictest3382292-21kworker/u8:0+events_unbound22:04:122
3207005994844,3cyclictest3496506-21kworker/u8:1+events_unbound00:04:102
3207005994640,4cyclictest3223659-21kworker/u8:2+events_unbound20:59:182
3207005994638,6cyclictest278-21systemd-journal21:35:002
3207005994541,3cyclictest3406989-21kworker/u8:2+events_unbound22:29:182
3206998994535,8cyclictest3243215-21ntpq19:44:110
3207002994435,6cyclictest278-21systemd-journal19:31:231
3206998994433,8cyclictest3347339-21ntpq21:29:100
320699899441,40cyclictest1-21systemd20:11:220
3207002994327,14cyclictest3268771-21apt-get20:10:021
3206998994333,7cyclictest3206815-21latency_hist19:10:010
320242524328,10sleep10-21swapper/119:08:421
3207005994233,7cyclictest3303562-21turbostat.cron20:45:002
3207002994235,5cyclictest3393286-21apt-get22:19:011
3207002994235,5cyclictest3393286-21apt-get22:19:011
3206998994231,7cyclictest3373172-21base6421:55:010
3207005994137,3cyclictest3464680-21kworker/u8:2+events_unbound23:29:072
3207005994136,3cyclictest3164491-21kworker/u8:0+events_unbound19:14:132
3207002994125,13cyclictest278-21systemd-journal22:11:211
3206998994131,7cyclictest3402453-21grep22:24:150
3207005994036,3cyclictest3259108-21kworker/u8:0+events_unbound20:25:012
3207005994036,3cyclictest2387910-21kworker/u8:4+flush-8:023:14:052
3207005994034,4cyclictest2387910-21kworker/u8:4+events_unbound21:05:042
3207002994033,5cyclictest278-21systemd-journal23:46:211
3206998994029,8cyclictest3329018-21diskstats21:14:010
3207002993931,5cyclictest278-21systemd-journal20:03:221
3207002993930,6cyclictest3308519-21latency_hist20:50:011
3206998993931,5cyclictest2387910-21kworker/u8:4+flush-8:021:09:120
3206998993930,7cyclictest3372735-21latency_hist21:55:010
320699899392,32cyclictest3196949-21kworker/0:0+events19:11:170
3207005993834,3cyclictest2387910-21kworker/u8:4+events_unbound21:45:002
3207002993829,7cyclictest278-21systemd-journal23:20:001
3207002993829,6cyclictest278-21systemd-journal22:09:211
3207002993827,8cyclictest278-21systemd-journal19:24:221
3207002993820,14cyclictest0-21swapper/121:19:001
3206998993831,4cyclictest3312752-21ntpq20:54:110
3206998993825,10cyclictest278-21systemd-journal19:50:010
35327712370,4sleep1291ktimers/100:39:011
3207005993733,3cyclictest3223659-21kworker/u8:2+events_unbound19:59:192
3207002993725,10cyclictest3321076-21kthreadcore21:04:041
3207002993720,15cyclictest3432176-21unixbench_singl22:54:161
3207002993719,16cyclictest0-21swapper/122:44:091
3207002993718,16cyclictest3283805-21latency_hist20:25:011
3207002993717,18cyclictest3342947-21unixbench_singl21:24:171
3207005993632,3cyclictest2387910-21kworker/u8:4+flush-8:019:15:222
3207002993629,5cyclictest3313966-21apt-get20:58:571
3207002993624,10cyclictest278-21systemd-journal20:11:221
3207002993624,10cyclictest0-21swapper/119:45:011
3207002993623,11cyclictest3343594-21apt-get21:28:571
3207002993621,13cyclictest3298620-21cron20:40:001
3207002993619,15cyclictest3289284-21apt-get20:33:551
3207002993617,17cyclictest0-21swapper/100:29:101
320699899363,27cyclictest3387813-21kworker/0:1+events23:38:530
3207005993531,3cyclictest2387910-21kworker/u8:4+events_unbound23:44:012
3207002993528,5cyclictest3442705-21apt-get23:08:561
3207002993521,12cyclictest3313261-21unixbench_multi20:54:181
3207002993518,15cyclictest0-21swapper/122:05:001
3207002993518,15cyclictest0-21swapper/121:14:041
3207002993517,16cyclictest3249145-21latency_hist19:50:011
3207002993517,16cyclictest0-21swapper/121:09:021
3207002993512,7cyclictest3207431-21apt-get19:13:571
3207002993511,6cyclictest3441504-21ntpq23:04:101
3207005993430,3cyclictest3464680-21kworker/u8:2+events_unbound00:19:142
3207005993430,3cyclictest3212056-21kworker/u8:1+events_unbound19:24:082
3207005993430,3cyclictest2387910-21kworker/u8:4+events_unbound19:45:072
3207002993424,8cyclictest3406908-21ntpq22:29:141
3207002993418,14cyclictest0-21swapper/122:48:551
3207002993418,14cyclictest0-21swapper/100:24:141
3207002993417,15cyclictest3473012-21irqcore23:39:001
3207002993417,15cyclictest3352821-21unixbench_singl21:34:161
3207002993417,15cyclictest0-21swapper/121:39:061
3207002993413,4cyclictest0-21swapper/121:44:141
3206998993429,3cyclictest3496562-21apt-get00:00:000
3206998993428,4cyclictest3333732-21apt-get21:18:590
3206998993427,5cyclictest3212056-21kworker/u8:1+flush-8:019:19:070
3206998993426,6cyclictest278-21systemd-journal00:10:330
3206998993425,7cyclictest3387790-21latency_hist22:10:000
3207005993327,4cyclictest3223659-21kworker/u8:2+events_unbound20:35:012
3207002993326,5cyclictest3457550-21apt-get23:23:551
3207002993325,6cyclictest3249539-21apt-get19:53:551
3207002993324,6cyclictest3412555-21latency_hist22:35:011
3207002993317,14cyclictest0-21swapper/123:59:041
3207002993316,15cyclictest0-21swapper/121:54:151
3207002993315,16cyclictest0-21swapper/123:34:121
3207002993314,2cyclictest0-21swapper/123:44:111
3207002993314,2cyclictest0-21swapper/122:39:011
3207002993313,5cyclictest0-21swapper/122:24:141
3207002993311,8cyclictest3238174-21ntpq19:39:081
3207002993311,3cyclictest0-21swapper/120:26:031
3206998993323,7cyclictest3323175-21grep21:04:150
32280482320,2sleep00-21swapper/019:29:060
3207005993226,4cyclictest3372589-21unixbench_multi21:54:162
3207005993222,7cyclictest3308520-21turbostat.cron20:50:002
3207002993216,14cyclictest0-21swapper/120:19:131
3207002993215,15cyclictest0-21swapper/121:59:021
3207002993215,15cyclictest0-21swapper/100:10:011
3207002993214,2cyclictest0-21swapper/119:19:081
3207002993214,2cyclictest0-21swapper/100:19:171
3207002993214,16cyclictest0-21swapper/100:30:211
3207002993213,2cyclictest0-21swapper/120:44:131
3207002993213,2cyclictest0-21swapper/119:59:161
3207002993213,2cyclictest0-21swapper/100:15:001
320699899326,24cyclictest3273954-21kworker/0:0+events20:33:490
3206998993227,3cyclictest3299459-21fschecks_count20:43:580
3206998993226,4cyclictest2387910-21kworker/u8:4+flush-8:023:45:520
3206998993223,7cyclictest3274441-21/usr/sbin/munin20:19:070
3206998993222,8cyclictest3416812-21ntpq22:39:080
320699899322,24cyclictest3521663-21kworker/0:1+events00:36:210
320699899321,25cyclictest3253948-21kworker/0:2+events20:05:010
3207005993127,2cyclictest3536512-21ls00:40:002
3207002993116,13cyclictest0-21swapper/122:59:061
3207002993115,15cyclictest3228801-21unixbench_singl19:29:151
3207002993113,2cyclictest0-21swapper/121:49:051
3207002993112,4cyclictest0-21swapper/100:04:121
3207002993110,7cyclictest3489210-21cut23:54:051
320699899313,23cyclictest3313437-21kworker/0:0+events22:02:210
320699899311,29cyclictest3253948-21kworker/0:2+events20:04:050
3207005993022,6cyclictest3309067-21apt-get20:53:592
3207005993021,7cyclictest3243808-21cat19:45:002
320699899309,17cyclictest3273954-21kworker/0:0+events20:26:050
320699899307,18cyclictest3313437-21kworker/0:0+events21:30:530
320699899306,19cyclictest3486691-21kworker/0:2+events00:25:450
3206998993025,4cyclictest3496506-21kworker/u8:1+flush-8:000:05:520
320699899302,22cyclictest3196949-21kworker/0:0+events19:20:130
3207002992910,2cyclictest0-21swapper/123:29:071
320699899294,20cyclictest3486691-21kworker/0:2+events00:30:290
3206998992925,2cyclictest3357902-21sendmail21:40:000
3206998992924,3cyclictest3408394-21fschecks_count22:34:000
3206998992922,5cyclictest838-21mta-sts-daemon22:19:170
3206998992922,5cyclictest838-21mta-sts-daemon22:19:170
320699899292,25cyclictest3387813-21kworker/0:1+events23:24:140
320699899292,25cyclictest3387813-21kworker/0:1+events22:29:050
320699899291,26cyclictest3486691-21kworker/0:2+events00:19:050
3206998992911,4cyclictest34794082kthreadcore23:44:040
3207005992816,9cyclictest278-21systemd-journal21:30:002
320699899289,18cyclictest3387813-21kworker/0:1+events23:25:050
320699899285,18cyclictest3196949-21kworker/0:0+events19:35:090
320699899282,25cyclictest3387813-21kworker/0:1+events22:45:130
3206998992822,4cyclictest0-21swapper/020:48:560
3206998992820,6cyclictest3363453-21aten2_r5power_e21:48:550
3206998992819,7cyclictest3471227-21ntpq23:34:080
3207005992723,3cyclictest3223659-21kworker/u8:2+events_unbound19:54:512
3207005992722,3cyclictest3437247-21sendmail23:00:002
320700299278,6cyclictest3449817-21tr23:14:051
320699899278,18cyclictest3486691-21kworker/0:2+events23:50:250
320699899278,18cyclictest3486691-21kworker/0:2+events00:02:330
320699899274,21cyclictest3273954-21kworker/0:0+events20:24:170
320699899272,24cyclictest3313437-21kworker/0:0+events20:57:090
320699899270,26cyclictest3313437-21kworker/0:0+events21:21:010
3207005992622,2cyclictest3398450-21cpuspeed_turbos22:23:572
3207005992621,4cyclictest3382292-21kworker/u8:0+events_unbound23:09:082
3207005992619,5cyclictest3464680-21kworker/u8:2+events_unbound00:27:592
320700599260,9cyclictest32771061kthreadcore20:19:052
320699899266,15cyclictest3196949-21kworker/0:0+events19:30:050
320699899262,23cyclictest3387813-21kworker/0:1+events23:12:010
320699899262,23cyclictest3196949-21kworker/0:0+events19:55:410
3207005992522,2cyclictest3482372-21aten2_r5power_p23:48:562
3207005992515,7cyclictest278-21systemd-journal22:45:002
320699899256,18cyclictest3293694-21kworker/0:1+events20:37:010
320699899255,18cyclictest3313437-21kworker/0:0+events21:42:410
320699899253,17cyclictest3387813-21kworker/0:1+events22:40:010
3206998992521,2cyclictest3254110-21runrttasks19:55:010
3206998992519,4cyclictest3442043-21unixbench_singl23:04:170
3207005992421,2cyclictest3467535-21aten2_r5power_v23:33:582
3207005992420,2cyclictest3264714-21fschecks_time20:09:002
320699899241,22cyclictest3387813-21kworker/0:1+events22:51:380
35043952230,3sleep3481ktimers/300:09:053
3207005992319,2cyclictest3496386-21unixbench_multi23:59:152
3207005992319,2cyclictest3269636-21aten2_r5power_p20:13:582
320699899237,15cyclictest3387813-21kworker/0:1+events23:18:330
320699899230,22cyclictest3387813-21kworker/0:1+events22:13:020
3207005992218,2cyclictest3413421-21cut22:39:002
3207005992217,3cyclictest3397546-21unixbench_singl22:19:222
3207005992217,3cyclictest3397546-21unixbench_singl22:19:212
3207005992214,6cyclictest3238637-21unixbench_multi19:39:152
32608592210,2sleep3481ktimers/320:04:043
3207005992117,2cyclictest3461921-21cron23:25:002
320700599202,5cyclictest0-21swapper/222:09:112
320700599201,8cyclictest3288102-21runrttasks20:29:092
3207005992017,2cyclictest3491332-21timerandwakeup23:54:162
3207005992016,2cyclictest0-21swapper/200:34:032
3207005992015,3cyclictest0-21swapper/221:14:172
3207005992011,7cyclictest3425974-21tr22:49:032
3207005992010,7cyclictest3261695-21tr20:04:052
32022002204,12sleep20-21swapper/219:05:452
320700599192,5cyclictest0-21swapper/222:50:382
320700599192,12cyclictest3408104-21apt-get22:33:572
320700599192,12cyclictest3333732-21apt-get21:19:012
3207005991915,3cyclictest3382292-21kworker/u8:0+events_unbound22:10:052
32024002193,9sleep30-21swapper/319:08:233
320700599187,8cyclictest3231816-21tr19:34:042
320700599183,2cyclictest161rcu_preempt00:13:562
3207005991814,3cyclictest371rcuc/200:08:352
3207005991814,2cyclictest3289633-21fschecks_time20:33:592
3207005991811,5cyclictest371rcuc/221:04:042
3207005991810,1cyclictest161rcu_preempt23:36:052
33621962177,6sleep30-21swapper/321:44:093
320700599177,2cyclictest161rcu_preempt00:23:572
320700599172,5cyclictest0-21swapper/223:00:452
320700599172,14cyclictest0-21swapper/219:28:222
320700599171,7cyclictest0-21swapper/221:49:082
3207005991713,3cyclictest3259108-21kworker/u8:0+flush-8:021:20:062
3207005991713,2cyclictest0-21swapper/223:19:062
3207005991712,3cyclictest0-21swapper/221:39:042
34577982165,7sleep30-21swapper/323:24:003
320700599162,5cyclictest0-21swapper/221:55:522
32695262142,7sleep30-21swapper/320:13:563
32112052142,8sleep30-21swapper/319:14:093
34662512132,7sleep30-21swapper/323:29:103
34386882133,6sleep30-21swapper/323:04:063
34234932133,6sleep30-21swapper/322:49:013
33937492132,7sleep30-21swapper/322:19:083
33937492132,7sleep30-21swapper/322:19:083
33727222132,7sleep30-21swapper/321:55:003
32887602132,6sleep30-21swapper/320:30:013
32391472132,7sleep30-21swapper/319:41:223
32202572134,5sleep30-21swapper/319:24:043
35221952122,6sleep30-21swapper/300:28:573
35121502122,6sleep30-21swapper/300:17:013
34921212122,6sleep30-21swapper/323:58:553
34768702122,5sleep30-21swapper/323:40:013
34764172122,6sleep30-21swapper/323:39:133
34520442122,6sleep30-21swapper/323:15:013
34485442122,6sleep30-21swapper/323:14:053
34467412122,6sleep30-21swapper/323:09:153
34273452122,6sleep30-21swapper/322:50:013
34131122122,6sleep30-21swapper/322:38:583
34035202122,6sleep30-21swapper/322:29:073
33878012122,6sleep30-21swapper/322:10:013
33738992122,6sleep30-21swapper/321:59:013
33631732122,6sleep30-21swapper/321:46:213
33488382122,6sleep30-21swapper/321:34:013
33380002122,6sleep30-21swapper/321:19:213
33291422122,6sleep30-21swapper/321:14:033
33134412122,5sleep30-21swapper/320:55:013
33090712122,6sleep30-21swapper/320:54:013
32846422122,6sleep30-21swapper/320:29:013
32800252122,6sleep30-21swapper/320:24:033
32638302122,6sleep30-21swapper/320:05:013
32442712122,6sleep30-21swapper/319:45:113
32344422122,6sleep30-21swapper/319:38:573
32183952122,6sleep30-21swapper/319:19:233
35341682112,5sleep30-21swapper/300:39:043
35172512112,5sleep30-21swapper/300:23:553
35070982112,6sleep30-21swapper/300:10:473
34909392112,5sleep30-21swapper/323:54:103
34826702112,6sleep30-21swapper/323:49:003
34679292112,5sleep30-21swapper/323:34:033
34342922112,5sleep30-21swapper/322:59:043
34177752112,5sleep30-21swapper/322:40:503
34120112112,5sleep30-21swapper/322:34:123
33982632112,5sleep30-21swapper/322:23:573
33826842112,6sleep30-21swapper/322:04:153
33578092112,6sleep30-21swapper/321:39:153
33433552112,6sleep30-21swapper/321:26:113
33385872112,5sleep30-21swapper/321:23:223
33238552112,5sleep30-21swapper/321:08:583
33187672112,6sleep30-21swapper/321:02:193
33040252113,5sleep30-21swapper/320:48:113
33034922112,5sleep30-21swapper/320:44:223
32742462112,5sleep30-21swapper/320:16:253
32549592112,5sleep30-21swapper/319:59:033
32493152113,5sleep30-21swapper/319:51:213
32292822112,5sleep30-21swapper/319:31:593
32243502112,6sleep30-21swapper/319:27:013
35268452102,5sleep30-21swapper/300:30:053
34971292102,5sleep30-21swapper/300:00:033
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional