You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-12 - 03:45

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack5slot4s.osadl.org (updated Tue May 12, 2026 00:44:14)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
9758692770,2sleep3471rcuc/300:36:033
648705997162,6cyclictest280-21systemd-journal22:00:000
648705996557,6cyclictest665372-21kworker/u8:3+flush-8:020:26:100
648705996555,7cyclictest898777-21latency_hist23:20:000
6988972640,3chrt281rcuc/119:56:041
648711996359,3cyclictest734465-21kworker/u8:1+flush-8:020:56:071
648711996257,3cyclictest655703-21kworker/u8:0+events_unbound19:40:581
648705996152,7cyclictest829069-21latency_hist22:10:010
648711996054,4cyclictest655703-21kworker/u8:0+events_unbound20:35:561
648711996050,4cyclictest665372-21kworker/u8:3+events_unbound20:00:561
648711995954,4cyclictest734465-21kworker/u8:1+events_unbound22:01:091
648711995953,5cyclictest868609-21kworker/u8:3+events_unbound23:41:051
648711995751,4cyclictest665372-21kworker/u8:3+events_unbound20:21:091
648711995651,4cyclictest899257-21kworker/u8:0+events_unbound00:15:551
648711995650,5cyclictest863670-21kworker/u8:1+events_unbound22:51:051
648711995650,5cyclictest675488-21kworker/u8:2+events_unbound19:36:081
648711995650,4cyclictest793853-21kworker/u8:0+events_unbound22:06:081
648711995649,5cyclictest899257-21kworker/u8:0+events_unbound00:35:561
648711995647,6cyclictest280-21systemd-journal23:28:171
648705995646,7cyclictest280-21systemd-journal19:50:010
648711995551,3cyclictest734465-21kworker/u8:1+flush-8:021:41:111
648711995550,3cyclictest793853-21kworker/u8:0+events_unbound22:41:081
648711995549,5cyclictest769689-21kworker/u8:0+events_unbound21:15:561
648711995549,4cyclictest655703-21kworker/u8:0+flush-8:020:31:081
648711995542,10cyclictest947687-21ntpq00:06:081
648711995450,3cyclictest769689-21kworker/u8:0+flush-8:021:20:581
648711995449,4cyclictest665372-21kworker/u8:3+flush-8:020:16:131
648711995448,5cyclictest734465-21kworker/u8:1+events_unbound22:31:091
648711995447,6cyclictest868609-21kworker/u8:3+events_unbound23:16:051
648711995447,6cyclictest854076-21kworker/u8:2+events_unbound23:30:571
648711995447,6cyclictest854076-21kworker/u8:2+events_unbound23:30:571
648711995348,3cyclictest665372-21kworker/u8:3+events_unbound20:26:121
648711995348,3cyclictest643659-21kworker/u8:3+events_unbound19:11:101
648711995347,4cyclictest655703-21kworker/u8:0+events_unbound19:50:571
648711995345,6cyclictest868609-21kworker/u8:3+events_unbound23:11:061
648717995247,3cyclictest868609-21kworker/u8:3+flush-8:023:20:572
648711995247,4cyclictest734465-21kworker/u8:1+flush-8:021:36:121
648717995142,7cyclictest280-21systemd-journal20:24:162
648711995147,3cyclictest793853-21kworker/u8:0+flush-8:021:56:101
648711995145,4cyclictest938879-21kworker/u8:4+events_unbound00:25:561
648711995145,4cyclictest868609-21kworker/u8:3+events_unbound23:00:561
648711995144,5cyclictest854076-21kworker/u8:2+events_unbound23:20:561
648711995046,3cyclictest734465-21kworker/u8:1+flush-8:021:31:121
648711995044,5cyclictest868609-21kworker/u8:3+events_unbound23:05:571
648711995043,6cyclictest863670-21kworker/u8:1+events_unbound22:46:011
648717994943,4cyclictest744763-21kworker/u8:2+flush-8:020:45:582
648711994943,4cyclictest591324-21kworker/u8:1+events_unbound19:16:111
648711994943,4cyclictest591324-21kworker/u8:1+events_unbound19:16:101
648705994943,4cyclictest665372-21kworker/u8:3+flush-8:020:01:100
648711994843,4cyclictest863670-21kworker/u8:1+flush-8:022:55:581
648711994843,4cyclictest734465-21kworker/u8:1+flush-8:021:26:071
648711994743,3cyclictest938879-21kworker/u8:4+events_unbound00:31:071
648711994741,4cyclictest839527-21apt-get22:20:511
648711994739,6cyclictest280-21systemd-journal20:45:001
648711994738,3cyclictest591324-21kworker/u8:1+events_unbound19:31:131
648705994731,13cyclictest280-21systemd-journal00:38:180
648717994640,4cyclictest675488-21kworker/u8:2+flush-8:019:51:102
648717994539,4cyclictest769689-21kworker/u8:0+flush-8:021:16:142
648711994541,3cyclictest828704-21kworker/u8:2+events_unbound22:11:111
648711994541,3cyclictest809208-21kworker/u8:3+events_unbound21:51:001
648711994537,6cyclictest280-21systemd-journal23:38:181
648711994440,3cyclictest744763-21kworker/u8:2+events_unbound20:46:101
648717994338,3cyclictest868609-21kworker/u8:3+flush-8:023:06:132
648711994339,3cyclictest899257-21kworker/u8:0+flush-8:000:11:111
648711994336,5cyclictest928672-21kworker/u8:1+events_unbound00:04:181
648711994238,3cyclictest744763-21kworker/u8:2+events_unbound21:01:101
648711994238,3cyclictest744763-21kworker/u8:2+events_unbound21:01:091
648711994237,4cyclictest655703-21kworker/u8:0+events_unbound20:06:061
648711994233,6cyclictest933852-21kworker/u8:3+flush-8:023:56:121
648705994235,5cyclictest868609-21kworker/u8:3+events_unbound23:01:100
648711994137,3cyclictest734465-21kworker/u8:1+events_unbound22:25:531
648711994136,4cyclictest899257-21kworker/u8:0+events_unbound00:21:001
648711994135,4cyclictest924036-21apt-get23:45:521
648711994135,4cyclictest655703-21kworker/u8:0+events_unbound19:46:071
648705994135,4cyclictest643659-21kworker/u8:3+flush-8:019:11:070
648705994134,5cyclictest280-21systemd-journal20:31:160
648705994133,6cyclictest734856-21/usr/sbin/munin20:36:050
648711994037,2cyclictest665372-21kworker/u8:3+events_unbound20:51:061
648711994036,3cyclictest655703-21kworker/u8:0+flush-8:019:20:571
648705994033,5cyclictest280-21systemd-journal21:35:000
648711993935,3cyclictest734465-21kworker/u8:1+events_unbound21:06:091
648711993929,7cyclictest280-21systemd-journal21:15:011
648705993935,3cyclictest655703-21kworker/u8:0+flush-8:020:06:100
648705993931,7cyclictest734465-21kworker/u8:1+events_unbound21:51:060
648705993928,9cyclictest715369-21diskstats20:15:560
648705993927,9cyclictest798191-21ntpq21:36:040
648711993834,3cyclictest828704-21kworker/u8:2+flush-8:022:16:171
648711993834,3cyclictest793853-21kworker/u8:0+events_unbound22:36:101
648705993833,3cyclictest962581-21kworker/u8:1+events_unbound00:21:130
648705993828,8cyclictest783378-21ntpq21:21:060
648705993827,8cyclictest280-21systemd-journal22:50:000
648705993827,8cyclictest280-21systemd-journal22:20:010
648711993733,3cyclictest854076-21kworker/u8:2+events_unbound23:51:081
648705993733,3cyclictest863670-21kworker/u8:1+flush-8:022:46:130
648705993732,4cyclictest734465-21kworker/u8:1+events_unbound22:26:080
648705993729,6cyclictest749431-21apt-get20:50:010
648717993631,3cyclictest953496-21latency_hist00:15:012
648717993629,4cyclictest754916-21apt-get20:55:542
648705993632,3cyclictest868609-21kworker/u8:3+events_unbound23:46:050
648705993632,3cyclictest675488-21kworker/u8:2+events_unbound19:51:070
648705993631,4cyclictest793853-21kworker/u8:0+flush-8:021:56:090
648705993631,3cyclictest665372-21kworker/u8:3+events_unbound21:25:560
648705993630,4cyclictest868609-21kworker/u8:3+events_unbound23:40:580
648705993630,4cyclictest863670-21kworker/u8:1+events_unbound23:00:000
648705993630,4cyclictest744763-21kworker/u8:2+events_unbound21:00:560
648705993630,4cyclictest744763-21kworker/u8:2+events_unbound21:00:560
648705993530,4cyclictest793853-21kworker/u8:0+events_unbound22:36:050
648705993529,4cyclictest734465-21kworker/u8:1+events_unbound20:45:010
648717993429,4cyclictest769689-21kworker/u8:0+flush-8:021:11:112
648717993429,3cyclictest938879-21kworker/u8:4+events_unbound00:26:072
648717993428,5cyclictest793853-21kworker/u8:0+events_unbound21:56:072
648717993428,4cyclictest829319-21gpgv22:10:012
648717993424,7cyclictest679424-21ntpq19:36:082
648705993429,3cyclictest899257-21kworker/u8:0+events_unbound00:16:120
648705993427,5cyclictest888907-21latency_hist23:10:010
648705993427,5cyclictest655703-21kworker/u8:0+flush-8:019:26:060
648705993426,6cyclictest854076-21kworker/u8:2+flush-8:023:51:070
648705993426,6cyclictest280-21systemd-journal20:15:000
648705993425,6cyclictest913861-21latency_hist23:35:010
648705993425,6cyclictest913861-21latency_hist23:35:010
648705993420,12cyclictest755267-21fschecks_time20:55:580
648717993328,3cyclictest854076-21kworker/u8:2+flush-8:023:35:582
648711993329,3cyclictest655703-21kworker/u8:0+events_unbound19:25:591
648705993328,3cyclictest734465-21kworker/u8:1+events_unbound22:20:560
648705993326,5cyclictest675488-21kworker/u8:2+flush-8:019:36:050
8158642320,6sleep3451irq_work/321:56:003
648717993228,3cyclictest828704-21kworker/u8:2+events_unbound22:16:072
648717993222,8cyclictest868967-21cat22:50:002
648711993228,3cyclictest665372-21kworker/u8:3+events_unbound20:13:181
648705993226,4cyclictest788772-21kworker/u8:2+events_unbound21:41:070
648705993226,4cyclictest665372-21kworker/u8:3+events_unbound20:21:070
648705993225,5cyclictest868609-21kworker/u8:3+events_unbound23:11:050
648705993222,8cyclictest774675-21/usr/sbin/munin21:16:070
6439102323,9sleep20-21swapper/219:05:372
648717993127,2cyclictest978195-21cron00:40:002
648717993126,4cyclictest675488-21kworker/u8:2+flush-8:019:56:082
648705993126,4cyclictest655703-21kworker/u8:0+flush-8:019:41:050
648705993125,4cyclictest973239-21cron00:35:000
648705993125,4cyclictest854076-21kworker/u8:2+events_unbound22:40:580
648705993124,5cyclictest675488-21kworker/u8:2+flush-8:019:56:060
648705993124,5cyclictest660734-21apt-get19:20:520
648705993122,7cyclictest834245-21cron22:15:000
648711993026,3cyclictest788772-21kworker/u8:2+events_unbound21:46:021
64850423022,3sleep00-21swapper/019:09:450
648717992925,3cyclictest962581-21kworker/u8:1+events_unbound00:21:082
648705992924,3cyclictest868609-21kworker/u8:3+flush-8:023:25:490
648705992923,4cyclictest938879-21kworker/u8:4+flush-8:000:25:570
648705992923,4cyclictest744763-21kworker/u8:2+events_unbound21:06:070
64871799289,4cyclictest0-21swapper/223:25:522
648717992825,2cyclictest655835-21aten2_r5power_e19:15:552
648717992825,2cyclictest655835-21aten2_r5power_e19:15:542
648717992820,6cyclictest839791-21fschecks_count22:20:562
648705992823,3cyclictest949187-21fschecks_time00:10:570
648705992823,3cyclictest773988-21unixbench_multi21:11:130
648705992818,7cyclictest660403-21latency_hist19:20:010
648705992818,7cyclictest660403-21latency_hist19:20:010
648717992720,5cyclictest913452-21unixbench_multi23:31:132
648717992720,5cyclictest913452-21unixbench_multi23:31:122
648717992719,6cyclictest280-21systemd-journal19:48:172
64870599278,18cyclictest849139-21kworker/0:0+events23:57:530
648705992722,3cyclictest806522-21kthreadcore21:46:030
648717992621,4cyclictest933852-21kworker/u8:3+flush-8:023:56:072
648717992618,6cyclictest655703-21kworker/u8:0+events_unbound20:30:002
648717992612,10cyclictest764825-21apt-get21:05:542
648705992621,3cyclictest0-21swapper/000:10:010
648705992620,4cyclictest916661-21kthreadcore23:36:020
648717992522,2cyclictest854394-21aten2_r5power_c22:35:542
648717992522,2cyclictest793795-21unixbench_singl21:31:132
648717992522,2cyclictest764499-21cron21:05:002
648717992522,2cyclictest764499-21cron21:05:002
648705992520,4cyclictest749029-21unixbench_multi20:46:120
648717992420,2cyclictest734993-21aten2_r5power_v20:35:542
648717992420,2cyclictest0-21swapper/220:20:002
648705992420,3cyclictest899257-21kworker/u8:0+events_unbound00:01:030
648705992420,2cyclictest0-21swapper/019:31:110
648705992417,5cyclictest903626-21grep23:21:120
648717992319,2cyclictest943283-21grep00:01:132
648717992319,2cyclictest670836-21tr19:30:552
648705992319,2cyclictest876-21mta-sts-daemon22:33:450
648717992219,2cyclictest968920-21fschecks_count00:30:582
648717992219,2cyclictest893828-21cron23:15:002
648717992218,3cyclictest0-21swapper/223:20:002
648717992218,2cyclictest714791-21cron20:15:002
6477072224,13sleep10-21swapper/119:06:081
64871799219,3cyclictest0-21swapper/219:10:552
648717992116,3cyclictest873728-21grep22:51:122
648717992116,3cyclictest744106-21unixbench_multi20:41:132
648717992116,3cyclictest704557-21grep20:01:132
64871799210,7cyclictest832436-21kthreadcore22:11:022
64871799202,13cyclictest863155-21ntpq22:41:072
648717992017,2cyclictest948165-21unixbench_multi00:06:142
648717992016,2cyclictest824119-21cron22:05:002
648717992011,7cyclictest706563-21kthreadcore20:06:012
7656772190,3chrt75-21kworker/3:1+events21:05:593
64871799199,7cyclictest670276-21cron19:30:012
64871799192,12cyclictest849420-21apt-get22:30:572
648717991915,2cyclictest0-21swapper/220:31:002
648717991914,3cyclictest779947-21fschecks_count21:20:582
64871799191,13cyclictest919143-21aten2_r5power_c23:40:532
64871799190,4cyclictest808159-21ntpq21:46:102
6477712193,8sleep30-21swapper/319:06:093
648717991814,2cyclictest0-21swapper/219:40:542
64871799179,6cyclictest877483-21cut22:56:042
648717991713,2cyclictest799693-21fschecks_count21:40:572
648717991712,3cyclictest0-21swapper/221:36:022
648717991711,4cyclictest955720-21kthreadcore00:16:012
64871799167,7cyclictest786417-21cut21:26:032
64871799162,2cyclictest0-21swapper/223:46:112
648717991613,2cyclictest929001-21aten2_r5power_c23:50:562
648717991613,2cyclictest0-21swapper/223:00:562
648717991613,2cyclictest0-21swapper/221:50:312
648717991611,3cyclictest0-21swapper/220:50:562
64871799152,1cyclictest0-21swapper/219:21:072
64871799151,10cyclictest844480-21apt-get22:25:512
8449362143,7sleep30-21swapper/322:25:573
9534792133,6sleep30-21swapper/300:15:013
8846612132,7sleep30-21swapper/323:05:593
8694472132,7sleep30-21swapper/322:50:543
8191922132,6sleep30-21swapper/322:00:023
8040332132,5sleep30-21swapper/321:45:013
7930292132,7sleep30-21swapper/321:31:053
7620332133,6sleep30-21swapper/321:01:033
7620332133,6sleep30-21swapper/321:01:033
6801922132,6sleep30-21swapper/319:40:023
9683632122,5sleep30-21swapper/300:30:023
9638122122,6sleep30-21swapper/300:25:573
9587902122,6sleep30-21swapper/300:20:553
9575572122,6sleep30-21swapper/300:16:043
9436512122,6sleep30-21swapper/300:05:023
9096102122,6sleep30-21swapper/323:30:593
9096102122,6sleep30-21swapper/323:30:593
9080612124,5sleep30-21swapper/323:26:063
9029582122,6sleep30-21swapper/323:21:043
8954642122,6sleep30-21swapper/323:16:013
8937692122,6sleep30-21swapper/323:14:183
8830462122,6sleep30-21swapper/323:01:053
8688262122,6sleep30-21swapper/322:49:183
8540642122,5sleep30-21swapper/322:35:013
8501402122,6sleep30-21swapper/322:31:043
8359662122,6sleep30-21swapper/322:16:033
8299852122,6sleep30-21swapper/322:10:573
8244522122,6sleep30-21swapper/322:05:563
8131792122,6sleep30-21swapper/321:51:113
7966322122,6sleep30-21swapper/321:36:023
7857662122,6sleep30-21swapper/321:26:033
7747322122,6sleep30-21swapper/321:15:563
7697462123,5sleep30-21swapper/321:10:543
7548902120,8sleep30-21swapper/320:55:533
7499062122,6sleep30-21swapper/320:50:163
7447812122,6sleep30-21swapper/320:45:463
7296542123,5sleep30-21swapper/320:30:013
7199822122,5sleep30-21swapper/320:20:023
7156142122,6sleep30-21swapper/320:16:013
7139562123,6sleep30-21swapper/320:11:073
7049522122,5sleep30-21swapper/320:05:003
6952782122,6sleep30-21swapper/319:55:023
6949262122,6sleep30-21swapper/319:53:173
6899642122,6sleep30-21swapper/319:47:563
9390202112,5sleep30-21swapper/300:00:563
9339082112,5sleep30-21swapper/323:55:553
9289432112,5sleep30-21swapper/323:50:533
9241222112,5sleep30-21swapper/323:45:553
9191402112,5sleep30-21swapper/323:40:543
9141452112,5sleep30-21swapper/323:35:533
8743852112,6sleep30-21swapper/322:55:443
8596932112,5sleep30-21swapper/322:40:593
8440972112,6sleep30-21swapper/322:24:183
8043962112,5sleep30-21swapper/321:45:583
7796302112,6sleep30-21swapper/321:20:533
7398552112,5sleep30-21swapper/320:40:523
7386872112,6sleep30-21swapper/320:36:073
7249542112,6sleep30-21swapper/320:25:483
7003732112,5sleep30-21swapper/320:00:563
6754872112,5sleep30-21swapper/319:35:323
6703832112,5sleep30-21swapper/319:30:023
6693872111,6sleep30-21swapper/319:26:053
6607062112,5sleep30-21swapper/319:20:513
6555922112,5sleep30-21swapper/319:15:063
6555922112,5sleep30-21swapper/319:15:063
6488692113,5sleep30-21swapper/319:10:363
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional