You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-19 - 04:28

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack5slot4s.osadl.org (updated Fri Dec 19, 2025 00:44:15)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
8009902890,2chrt575-21kworker/3:2+events20:20:003
8812562770,4sleep30-21swapper/321:40:013
9498812670,3sleep00-21swapper/022:49:150
7913242620,2sleep3481ktimers/320:10:013
729906995543,9cyclictest697861-21munin-node19:15:011
729901995443,8cyclictest278-21systemd-journal20:35:010
729901995036,3cyclictest826045-21kworker/u8:3+events_unbound20:45:380
729901995036,3cyclictest826045-21kworker/u8:3+events_unbound20:45:370
729910994938,9cyclictest850663-21cp21:10:012
729906994843,4cyclictest761298-21kworker/u8:2+flush-8:019:54:021
729901994539,4cyclictest736949-21kworker/u8:0+flush-8:019:34:120
729901994536,7cyclictest945218-21latency_hist22:45:010
729910994435,7cyclictest896179-21cat21:55:002
729901994439,4cyclictest875893-21kworker/u8:3+flush-8:023:29:130
729901994439,4cyclictest826045-21kworker/u8:3+flush-8:020:59:100
729901994439,4cyclictest761298-21kworker/u8:2+flush-8:019:54:170
72990199440,42cyclictest825840-21munin-run20:45:000
7740722430,4sleep20-21swapper/219:54:072
729901994337,4cyclictest736949-21kworker/u8:0+events_unbound19:40:000
729901994237,4cyclictest881352-21kworker/u8:0+flush-8:021:49:140
729901994237,3cyclictest970269-21kworker/u8:1+events_unbound23:39:040
729901994237,3cyclictest950356-21kworker/u8:2+events_unbound23:09:030
729901994236,4cyclictest875893-21kworker/u8:3+events_unbound22:20:010
729901994136,3cyclictest980146-21kworker/u8:2+flush-8:023:49:120
729901994036,3cyclictest980146-21kworker/u8:2+flush-8:023:34:150
729906993935,3cyclictest806119-21kworker/u8:0+flush-8:020:29:001
729906993934,4cyclictest781513-21kworker/u8:3+flush-8:020:24:161
729906993934,3cyclictest881352-21kworker/u8:0+flush-8:021:49:141
729906993833,4cyclictest950356-21kworker/u8:2+events_unbound22:54:021
729906993833,4cyclictest875893-21kworker/u8:3+flush-8:022:09:141
729901993833,4cyclictest781513-21kworker/u8:3+flush-8:020:04:080
729901993832,4cyclictest736949-21kworker/u8:0+flush-8:019:29:190
7252582384,10sleep10-21swapper/119:06:161
729901993733,3cyclictest720298-21kworker/u8:1+events_unbound19:15:060
729901993732,4cyclictest915721-21kworker/u8:1+events_unbound22:39:090
729906993631,4cyclictest881352-21kworker/u8:0+flush-8:021:54:151
729906993627,7cyclictest278-21systemd-journal20:04:041
729906993627,7cyclictest1000413-21apt-get23:43:551
729901993631,3cyclictest970269-21kworker/u8:1+events_unbound23:19:150
729901993630,5cyclictest736949-21kworker/u8:0+events_unbound19:44:110
729901993630,4cyclictest761298-21kworker/u8:2+events_unbound19:58:580
729901993627,7cyclictest875893-21kworker/u8:3+events_unbound23:23:590
729901993626,8cyclictest1038580-21ntpq00:19:080
729910993528,5cyclictest881118-21cat21:40:012
729901993531,3cyclictest826045-21kworker/u8:3+events_unbound21:24:200
729901993530,3cyclictest875893-21kworker/u8:3+events_unbound22:24:030
729901993529,4cyclictest835680-21kworker/u8:0+events_unbound21:19:030
729901993524,8cyclictest970569-21/usr/sbin/munin23:14:080
729906993429,4cyclictest781513-21kworker/u8:3+flush-8:020:09:001
729906993427,5cyclictest278-21systemd-journal22:30:001
729906993424,8cyclictest860561-21apt-get21:20:001
729906993423,8cyclictest999613-21latency_hist23:40:011
729901993429,3cyclictest881352-21kworker/u8:0+events_unbound21:55:000
729901993428,4cyclictest786770-21apt-get20:08:550
729901993423,7cyclictest950356-21kworker/u8:2+events_unbound22:53:560
729901993420,5cyclictest875893-21kworker/u8:3+events_unbound22:09:100
729910993324,7cyclictest278-21systemd-journal21:10:072
729906993329,3cyclictest875893-21kworker/u8:3+flush-8:022:34:131
729906993328,4cyclictest875893-21kworker/u8:3+flush-8:022:44:121
729906993328,4cyclictest826045-21kworker/u8:3+flush-8:020:54:151
729906993328,3cyclictest735569-21kthreadcore19:15:041
729906993327,5cyclictest835680-21kworker/u8:0+events_unbound21:20:031
729906993326,5cyclictest915721-21kworker/u8:1+flush-8:022:39:111
729901993327,4cyclictest970269-21kworker/u8:1+flush-8:023:44:000
729901993327,4cyclictest881352-21kworker/u8:0+events_unbound23:04:080
729901993327,4cyclictest881352-21kworker/u8:0+events_unbound23:04:080
729901993327,4cyclictest866216-21kworker/u8:1+flush-8:021:39:060
729901993327,4cyclictest1010091-21kworker/u8:0+events_unbound23:55:000
729901993326,5cyclictest751531-21kworker/u8:1+events_unbound20:40:000
729901993326,4cyclictest1029341-21kworker/u8:3+events_unbound00:35:080
729901993324,7cyclictest929915-21ntpq22:29:110
729901993323,8cyclictest800964-21latency_hist20:20:010
72990199330,30cyclictest835679-21true20:55:000
7252692334,9sleep20-21swapper/219:06:252
729910993225,5cyclictest278-21systemd-journal22:21:372
729906993226,4cyclictest881352-21kworker/u8:0+events_unbound22:05:001
729901993227,4cyclictest736949-21kworker/u8:0+flush-8:019:24:100
729901993227,3cyclictest720298-21kworker/u8:1+events_unbound19:14:020
729901993225,5cyclictest980146-21kworker/u8:2+events_unbound00:33:560
729901993225,5cyclictest826045-21kworker/u8:3+flush-8:021:09:050
729901993225,5cyclictest766844-21/usr/sbin/munin19:49:070
729901993225,5cyclictest766844-21/usr/sbin/munin19:49:070
8795852310,5sleep10-21swapper/121:39:061
729910993127,3cyclictest970269-21kworker/u8:1+events_unbound23:39:082
729910993126,3cyclictest741476-21unixbench_multi19:19:142
729906993125,4cyclictest761298-21kworker/u8:2+flush-8:019:49:061
729906993125,4cyclictest761298-21kworker/u8:2+flush-8:019:49:051
729901993127,3cyclictest1010091-21kworker/u8:0+events_unbound00:25:090
729901993119,4cyclictest835680-21kworker/u8:0+events_unbound21:30:380
729906993025,4cyclictest866216-21kworker/u8:1+flush-8:021:34:021
729906993025,4cyclictest826045-21kworker/u8:3+events_unbound21:09:041
729906993024,5cyclictest875893-21kworker/u8:3+events_unbound23:28:591
729906993024,4cyclictest751531-21kworker/u8:1+events_unbound20:30:021
729906993021,7cyclictest750893-21ntpq19:29:101
729901993026,3cyclictest980146-21kworker/u8:2+flush-8:000:05:000
729901993026,3cyclictest751531-21kworker/u8:1+flush-8:020:14:140
729901993026,3cyclictest411-21dbus-daemon22:15:020
729901993021,6cyclictest855622-21latency_hist21:15:010
729910992923,4cyclictest800837-21unixbench_singl20:19:162
729906992923,5cyclictest761298-21kworker/u8:2+flush-8:021:44:171
729906992923,4cyclictest1039812-21apt-get00:23:561
729906992922,4cyclictest278-21systemd-journal23:11:081
729901992925,3cyclictest881352-21kworker/u8:0+events_unbound21:55:070
729901992925,3cyclictest881352-21kworker/u8:0+events_unbound21:55:070
729901992925,3cyclictest1010091-21kworker/u8:0+flush-8:000:14:170
729901992925,3cyclictest1010091-21kworker/u8:0+flush-8:000:14:170
729901992918,8cyclictest278-21systemd-journal23:00:000
729906992824,3cyclictest915721-21kworker/u8:1+flush-8:022:19:131
729906992824,3cyclictest881352-21kworker/u8:0+flush-8:023:04:051
729906992824,3cyclictest881352-21kworker/u8:0+flush-8:023:04:051
729906992823,4cyclictest980146-21kworker/u8:2+flush-8:023:54:141
729906992822,5cyclictest970269-21kworker/u8:1+events_unbound23:58:591
729906992819,7cyclictest900322-21ntpq21:59:071
729906992819,7cyclictest900322-21ntpq21:59:071
729901992823,4cyclictest1029341-21kworker/u8:3+flush-8:000:24:010
729901992822,4cyclictest781513-21kworker/u8:3+events_unbound20:24:120
729910992724,2cyclictest959855-21unixbench_singl22:59:162
729910992723,3cyclictest1034184-21unixbench_multi00:14:162
729910992723,3cyclictest1034184-21unixbench_multi00:14:162
729910992720,5cyclictest1019549-40logrotate00:00:002
729906992719,6cyclictest950133-21latency_hist22:50:011
729906992719,6cyclictest1009031-21ntpq23:49:071
729901992723,3cyclictest935405-21idleruntime-cro22:35:000
729901992722,4cyclictest980146-21kworker/u8:2+flush-8:000:09:040
729910992623,2cyclictest805888-21apt20:25:002
729910992620,4cyclictest810658-21unixbench_multi20:29:162
72991099260,24cyclictest746610-21cron19:25:002
729906992620,4cyclictest1044724-21apt-get00:28:551
729906992617,7cyclictest984825-21latency_hist23:25:011
729901992621,4cyclictest806119-21kworker/u8:0+flush-8:020:29:100
729901992621,3cyclictest970269-21kworker/u8:1+events_unbound23:58:570
729910992521,2cyclictest856203-21aten2_r5power_c21:18:572
729910992521,2cyclictest786857-21aten2_r5power_p20:08:582
72990699258,5cyclictest0-21swapper/121:13:451
729906992521,2cyclictest797317-21irqrtprio20:19:031
729906992521,2cyclictest0-21swapper/122:59:351
729906992519,5cyclictest970269-21kworker/u8:1+events_unbound00:09:151
729906992519,5cyclictest736949-21kworker/u8:0+events_unbound19:23:561
729906992519,4cyclictest980146-21kworker/u8:2+events_unbound00:39:141
729906992519,4cyclictest950356-21kworker/u8:2+flush-8:023:09:121
729906992519,4cyclictest826045-21kworker/u8:3+flush-8:020:59:061
729901992521,3cyclictest881352-21kworker/u8:0+flush-8:021:44:060
729901992521,3cyclictest881352-21kworker/u8:0+events_unbound22:04:130
729901992521,3cyclictest761298-21kworker/u8:2+events_unbound21:29:160
729910992420,3cyclictest831389-21aten2_r5power_p20:53:592
729910992420,3cyclictest1023786-21tail00:04:112
729910992419,3cyclictest0-21swapper/221:05:002
729910992418,2cyclictest0-21swapper/220:33:572
729906992420,2cyclictest865746-21apt-get21:25:011
729906992420,2cyclictest0-21swapper/100:15:001
729906992420,2cyclictest0-21swapper/100:15:001
729906992420,2cyclictest0-21swapper/100:04:021
729906992419,3cyclictest970269-21kworker/u8:1+events_unbound23:19:031
729906992419,3cyclictest0-21swapper/120:39:031
729906992418,4cyclictest766304-21cron19:45:001
729901992420,3cyclictest826045-21kworker/u8:3+events_unbound21:04:180
7253542242,4sleep00-21swapper/019:07:320
72991099233,10cyclictest0-21swapper/221:25:002
729910992320,2cyclictest825649-21unixbench_multi20:44:172
729910992320,2cyclictest820875-21cron20:40:012
729910992319,3cyclictest767104-21cpuspeed_turbos19:48:582
729910992319,3cyclictest767104-21cpuspeed_turbos19:48:582
729910992319,2cyclictest985601-21cpuspeed_turbos23:29:002
729910992319,2cyclictest0-21swapper/223:05:012
729910992319,2cyclictest0-21swapper/223:05:002
72991099230,5cyclictest935395-21cron22:35:002
729906992319,3cyclictest830665-21unixbench_singl20:49:151
729906992319,3cyclictest830665-21unixbench_singl20:49:151
729906992319,3cyclictest751531-21kworker/u8:1+flush-8:020:44:101
729906992319,2cyclictest0-21swapper/122:14:061
729906992318,4cyclictest881352-21kworker/u8:0+flush-8:022:20:311
729906992318,3cyclictest0-21swapper/119:39:151
729906992316,5cyclictest826045-21kworker/u8:3+flush-8:021:04:081
729910992219,2cyclictest901804-21fschecks_count22:03:592
729910992219,2cyclictest836507-21fschecks_count20:59:012
729910992218,2cyclictest0-21swapper/219:33:562
729910992217,3cyclictest0-21swapper/222:40:002
729910992215,5cyclictest278-21systemd-journal21:45:002
729910992215,5cyclictest278-21systemd-journal20:00:002
729906992217,3cyclictest0-21swapper/100:34:071
72991099211,9cyclictest9434061kthreadcore22:44:052
729910992117,2cyclictest0-21swapper/219:40:002
729910992117,2cyclictest0-21swapper/200:25:002
729910992112,7cyclictest867179-21sed21:29:032
729906992117,2cyclictest0-21swapper/123:35:011
729906992117,2cyclictest0-21swapper/120:14:021
729906992117,2cyclictest0-21swapper/119:59:121
729906992117,2cyclictest0-21swapper/119:34:021
729906992113,6cyclictest1038656-21ntpq00:19:101
72991099207,2cyclictest0-21swapper/200:19:022
729910992016,3cyclictest0-21swapper/222:50:012
729910992016,2cyclictest751358-21unixbench_multi19:29:192
729910992012,6cyclictest1055198-21sed00:39:022
72991099200,8cyclictest898648-21cut21:59:042
72991099200,8cyclictest898648-21cut21:59:042
72991099192,4cyclictest0-21swapper/220:14:092
729910991916,2cyclictest911630-21fschecks_count22:14:002
72991099190,9cyclictest9293011kthreadcore22:29:052
72991099190,7cyclictest9734381kthreadcore23:14:082
10164192190,3sleep3575-21kworker/3:2+events23:59:053
8710362182,2sleep20-21swapper/221:30:022
8416732180,3sleep3575-21kworker/3:2+events21:04:023
729910991815,2cyclictest950970-21fschecks_count22:54:002
729910991814,2cyclictest0-21swapper/223:49:122
729910991814,2cyclictest0-21swapper/220:03:572
729910991813,3cyclictest0-21swapper/223:10:002
729910991811,5cyclictest907400-21cut22:09:042
729910991811,5cyclictest1050638-21cut00:34:032
729910991810,6cyclictest1044949-21tr00:28:582
72991099180,8cyclictest10124711kthreadcore23:54:052
72991099180,16cyclictest1000499-21cut23:43:582
7253992183,8sleep30-21swapper/319:08:073
72991099172,2cyclictest0-21swapper/223:15:592
729910991712,4cyclictest875893-21kworker/u8:3+flush-8:023:20:362
729910991712,4cyclictest751531-21kworker/u8:1+flush-8:020:49:152
729910991712,4cyclictest751531-21kworker/u8:1+flush-8:020:49:142
729910991712,3cyclictest731107-21tr19:14:032
729910991712,3cyclictest0-21swapper/223:34:042
72991099171,12cyclictest1028776-21ntpq00:09:132
72991099162,13cyclictest0-21swapper/221:48:512
729910991612,2cyclictest0-21swapper/219:43:572
729910991611,3cyclictest0-21swapper/222:19:042
7372332152,8sleep30-21swapper/319:18:543
9648582143,7sleep30-21swapper/323:05:003
9648582143,7sleep30-21swapper/323:05:003
9034602140,3sleep3451irq_work/322:04:043
9593272132,7sleep30-21swapper/322:59:103
8550612132,7sleep30-21swapper/321:14:143
8504292132,7sleep30-21swapper/321:10:013
8104542132,7sleep30-21swapper/320:29:163
7956652132,7sleep30-21swapper/320:14:153
7613972132,6sleep30-21swapper/319:40:023
10353302130,2sleep3471rcuc/300:19:023
9946902122,6sleep30-21swapper/323:35:013
9906612122,6sleep30-21swapper/323:34:013
9743162122,6sleep30-21swapper/323:14:113
9544772123,5sleep30-21swapper/322:54:133
9490552122,6sleep30-21swapper/322:49:073
9304992122,5sleep30-21swapper/322:30:013
9264562122,6sleep30-21swapper/322:29:013
9247972122,7sleep30-21swapper/322:24:073
9162742122,6sleep30-21swapper/322:18:583
9064352123,5sleep30-21swapper/322:08:593
9009552122,6sleep30-21swapper/322:00:003
9009552122,6sleep30-21swapper/322:00:003
8907832122,6sleep30-21swapper/321:49:173
8719762121,7sleep30-21swapper/321:34:043
8657612122,5sleep30-21swapper/321:25:013
8570052122,6sleep30-21swapper/321:19:033
8371022122,6sleep30-21swapper/320:59:053
8258322122,6sleep30-21swapper/320:45:013
8258322122,6sleep30-21swapper/320:45:013
8009902122,6sleep30-21swapper/320:20:013
7861372122,6sleep30-21swapper/320:04:163
7719872122,6sleep30-21swapper/319:53:583
7712152122,6sleep30-21swapper/319:50:003
7712152122,6sleep30-21swapper/319:50:003
7608182122,6sleep30-21swapper/319:39:133
7306902123,6sleep30-21swapper/319:14:023
10549172122,6sleep30-21swapper/300:39:013
10293772122,6sleep30-21swapper/300:10:003
10195772122,6sleep30-21swapper/300:00:013
9851682112,6sleep30-21swapper/323:26:353
9802532112,5sleep30-21swapper/323:21:493
9751832112,5sleep30-21swapper/323:15:073
9654632112,5sleep30-21swapper/323:06:443
9407012112,6sleep30-21swapper/322:41:573
9356382113,5sleep30-21swapper/322:35:153
9110552112,5sleep30-21swapper/322:10:353
8909272112,5sleep30-21swapper/321:50:013
8815182112,6sleep30-21swapper/321:43:153
8610392112,5sleep30-21swapper/321:20:093
8310012112,5sleep30-21swapper/320:50:223
8219812112,5sleep30-21swapper/320:44:053
8165302112,6sleep30-21swapper/320:38:593
8114682113,5sleep30-21swapper/320:32:253
7769072112,5sleep30-21swapper/319:58:593
7519662113,5sleep30-21swapper/319:32:593
7468962113,5sleep30-21swapper/319:25:403
7419782112,6sleep30-21swapper/319:21:113
10502282112,5sleep30-21swapper/300:34:033
10444672112,6sleep30-21swapper/300:25:573
10394902112,5sleep30-21swapper/300:20:073
10299182112,5sleep30-21swapper/300:13:573
10299182112,5sleep30-21swapper/300:13:573
10107122112,5sleep30-21swapper/323:54:033
10050062112,6sleep30-21swapper/323:45:243
10001482112,5sleep30-21swapper/323:40:513
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional