You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-24 - 11:37

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack5slot4s.osadl.org (updated Fri Apr 24, 2026 00:44:15)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
132058996459,4cyclictest194230-21kworker/u8:2+events_unbound20:31:261
132058996258,3cyclictest287019-21kworker/u8:2+events_unbound00:31:201
132060996152,7cyclictest451807-21cp00:29:592
132058996056,3cyclictest318089-21kworker/u8:3+events_unbound22:21:151
132058996051,6cyclictest347491-21latency_hist22:45:011
132058995955,3cyclictest223693-21kworker/u8:1+events_unbound20:46:231
132058995854,3cyclictest194230-21kworker/u8:2+events_unbound21:06:231
132058995753,3cyclictest411558-21kworker/u8:3+events_unbound00:01:091
132058995753,3cyclictest287019-21kworker/u8:2+events_unbound00:11:261
132058995753,3cyclictest213803-21kworker/u8:3+events_unbound21:21:271
132058995753,3cyclictest213803-21kworker/u8:3+events_unbound21:21:271
132058995753,3cyclictest194230-21kworker/u8:2+events_unbound20:26:231
132058995752,3cyclictest287019-21kworker/u8:2+events_unbound23:11:131
132058995652,3cyclictest318089-21kworker/u8:3+events_unbound22:16:101
132058995651,4cyclictest273243-21kworker/u8:1+events_unbound21:41:141
132054995645,8cyclictest362935-21diskstats23:01:110
132058995551,3cyclictest381276-21kworker/u8:0+events_unbound23:51:221
132058995551,3cyclictest132166-21kworker/u8:0+events_unbound20:01:101
132058995549,4cyclictest112353-21kworker/u8:2+events_unbound19:31:231
132058995450,3cyclictest158771-21kworker/u8:1+events_unbound19:56:231
132058995450,3cyclictest132166-21kworker/u8:0+events_unbound19:36:181
132058995449,4cyclictest99894-21kworker/u8:1+events_unbound19:16:111
132054995446,6cyclictest194230-21kworker/u8:2+flush-8:020:11:110
132058995349,3cyclictest371921-21kworker/u8:1+events_unbound23:16:091
132058995349,3cyclictest293056-21kworker/u8:1+events_unbound21:51:131
132058995349,3cyclictest287019-21kworker/u8:2+events_unbound23:56:121
132058995349,3cyclictest213803-21kworker/u8:3+events_unbound22:01:271
132058995349,3cyclictest158771-21kworker/u8:1+events_unbound20:06:231
132058995242,7cyclictest336777-21ntpq22:31:211
132054995244,6cyclictest132166-21kworker/u8:0+flush-8:020:06:100
132058995147,3cyclictest318089-21kworker/u8:3+events_unbound23:01:081
132058995147,3cyclictest287019-21kworker/u8:2+events_unbound22:51:111
132058995147,3cyclictest287019-21kworker/u8:2+events_unbound00:16:081
132058995147,3cyclictest213803-21kworker/u8:3+events_unbound21:16:111
132058995147,3cyclictest213803-21kworker/u8:3+events_unbound21:16:111
132054995142,7cyclictest377438-21/usr/sbin/munin23:16:190
132054995141,7cyclictest280-21systemd-journal21:45:010
132054995041,6cyclictest456899-21latency_hist00:35:010
132060994941,6cyclictest280-21systemd-journal20:05:002
132058994945,3cyclictest213803-21kworker/u8:3+events_unbound21:36:151
132058994945,3cyclictest132166-21kworker/u8:0+events_unbound20:21:081
132058994945,3cyclictest132166-21kworker/u8:0+events_unbound20:11:141
3996402480,2sleep3481ktimers/323:36:163
132058994844,3cyclictest396773-21kworker/u8:1+events_unbound23:41:091
132058994844,3cyclictest318089-21kworker/u8:3+events_unbound22:26:251
132058994844,3cyclictest213803-21kworker/u8:3+events_unbound21:31:101
132058994844,3cyclictest213803-21kworker/u8:3+events_unbound20:36:231
132058994844,3cyclictest132166-21kworker/u8:0+events_unbound19:46:131
132054994837,9cyclictest280-21systemd-journal21:00:190
132058994743,3cyclictest287019-21kworker/u8:2+events_unbound21:56:121
132058994743,3cyclictest223693-21kworker/u8:1+events_unbound21:01:081
132058994743,3cyclictest194230-21kworker/u8:2+events_unbound20:16:121
132054994740,5cyclictest317608-21apt-get22:15:010
132058994642,3cyclictest194230-21kworker/u8:2+events_unbound20:51:291
132058994641,4cyclictest287019-21kworker/u8:2+events_unbound23:21:111
132054994636,7cyclictest208830-21latency_hist20:25:010
132058994541,3cyclictest287019-21kworker/u8:2+events_unbound23:36:291
132054994541,3cyclictest273243-21kworker/u8:1+flush-8:021:31:270
132058994440,3cyclictest411558-21kworker/u8:3+events_unbound00:36:131
132058994440,3cyclictest287019-21kworker/u8:2+events_unbound23:31:091
132058994440,3cyclictest194230-21kworker/u8:2+events_unbound21:26:241
132054994435,6cyclictest297786-21latency_hist21:55:010
132058994339,3cyclictest149231-21kworker/u8:3+events_unbound19:26:251
132058994338,4cyclictest287019-21kworker/u8:2+events_unbound22:46:281
132058994333,8cyclictest147930-21ntpq19:21:201
132054994336,5cyclictest437192-21/usr/sbin/munin00:16:180
132054994335,6cyclictest308045-21apt-get22:06:050
132054994333,8cyclictest158071-21ntpq19:31:200
132058994238,3cyclictest194230-21kworker/u8:2+events_unbound21:11:181
132058994238,3cyclictest194230-21kworker/u8:2+events_unbound21:11:181
132054994236,4cyclictest318089-21kworker/u8:3+flush-8:022:41:250
132058994137,3cyclictest396773-21kworker/u8:1+events_unbound23:46:251
132054994132,7cyclictest280-21systemd-journal22:50:000
132060994033,5cyclictest268410-21apt-get21:26:052
132058994036,3cyclictest352145-21kworker/u8:0+events_unbound23:06:261
132058994036,3cyclictest158771-21kworker/u8:1+events_unbound19:41:281
132058994035,4cyclictest132166-21kworker/u8:0+events_unbound19:13:211
132054994034,4cyclictest280-21systemd-journal22:31:190
132060993929,8cyclictest280-21systemd-journal19:25:002
132058993935,3cyclictest318089-21kworker/u8:3+events_unbound23:26:261
13205899390,36cyclictest1-21systemd23:00:001
132054993934,4cyclictest194230-21kworker/u8:2+flush-8:021:06:110
132054993927,9cyclictest447381-21diskstats00:26:100
132058993834,3cyclictest132166-21kworker/u8:0+events_unbound19:51:201
132058993833,4cyclictest287019-21kworker/u8:2+events_unbound22:38:361
132054993832,4cyclictest280-21systemd-journal19:55:000
132058993732,4cyclictest307440-21kworker/u8:0+events_unbound22:12:191
132054993730,5cyclictest280-21systemd-journal20:30:000
132054993728,6cyclictest461836-21latency_hist00:40:000
132058993632,3cyclictest287019-21kworker/u8:2+events_unbound00:06:261
4376572350,5sleep20-21swapper/200:16:122
132060993531,3cyclictest189698-21irqcore20:06:122
132058993532,2cyclictest307440-21kworker/u8:0+events_unbound22:06:261
132058993529,4cyclictest442174-21apt-get00:21:041
132054993531,2cyclictest223693-21kworker/u8:1+flush-8:020:56:190
132054993529,4cyclictest99894-21kworker/u8:1+flush-8:019:21:110
132054993529,4cyclictest287019-21kworker/u8:2+flush-8:021:46:250
4468022340,7sleep30-21swapper/300:25:003
132060993427,5cyclictest402298-21apt-get23:41:062
132058993430,3cyclictest441545-21kworker/u8:1+events_unbound00:25:441
132058993429,3cyclictest239525-21irqrtprio20:56:131
132054993426,5cyclictest263148-21latency_hist21:20:010
132054993426,5cyclictest263148-21latency_hist21:20:010
132054993423,8cyclictest280-21systemd-journal23:30:170
132054993327,4cyclictest194230-21kworker/u8:2+flush-8:020:51:240
132054993322,9cyclictest0-21swapper/019:20:000
132054993316,14cyclictest280-21systemd-journal19:41:180
132058993228,3cyclictest213803-21kworker/u8:3+events_unbound21:50:011
132058993227,4cyclictest213803-21kworker/u8:3+events_unbound20:41:141
1317872323,3sleep00-21swapper/019:09:040
132054993126,3cyclictest287019-21kworker/u8:2+events_unbound23:11:190
132054993125,4cyclictest318089-21kworker/u8:3+flush-8:023:26:200
132054993124,5cyclictest163870-21latency_hist19:40:010
132054993122,7cyclictest280-21systemd-journal21:15:000
132054993122,7cyclictest280-21systemd-journal21:15:000
13205499310,29cyclictest1-21systemd20:42:190
132054993026,3cyclictest158771-21kworker/u8:1+flush-8:019:46:490
132054993024,4cyclictest287019-21kworker/u8:2+flush-8:022:21:240
132054993023,5cyclictest371856-21grep23:06:260
132054993022,6cyclictest318089-21kworker/u8:3+events_unbound23:25:000
132054993021,7cyclictest280-21systemd-journal23:55:010
13206099299,10cyclictest0-21swapper/222:51:162
132054992924,4cyclictest411558-21kworker/u8:3+flush-8:000:06:160
132054992923,4cyclictest213803-21kworker/u8:3+events_unbound21:36:260
132054992922,5cyclictest132166-21kworker/u8:0+events_unbound19:55:000
132054992919,8cyclictest280-21systemd-journal23:55:000
132060992823,3cyclictest253641-21aten2_r5power_c21:11:082
132060992823,3cyclictest253641-21aten2_r5power_c21:11:082
132054992824,3cyclictest194230-21kworker/u8:2+events_unbound20:36:110
132054992823,4cyclictest223693-21kworker/u8:1+events_unbound20:46:200
13205499281,22cyclictest328306-21df_inode22:26:100
13206099277,4cyclictest0-21swapper/219:36:122
13206099274,6cyclictest217365-21kthreadcore20:31:172
132060992724,2cyclictest277356-21mailstats21:31:252
132060992722,3cyclictest229196-21cpuspeed_turbos20:46:082
13206099270,15cyclictest366279-21sed23:01:192
132054992723,3cyclictest213803-21kworker/u8:3+events_unbound22:01:150
132054992722,3cyclictest411558-21kworker/u8:3+flush-8:000:01:160
132054992720,5cyclictest99894-21kworker/u8:1+events_unbound19:15:010
132054992718,7cyclictest280-21systemd-journal20:35:000
132054992718,7cyclictest153142-21ntpq19:26:180
132054992716,9cyclictest361474-21ntpq22:56:180
132060992622,2cyclictest377495-21aten2_r5power_c23:16:092
132060992621,3cyclictest243789-21aten2_r5power_c21:01:082
13206099260,14cyclictest1-21systemd21:10:002
132054992621,3cyclictest322840-21systemd-run22:20:010
132054992620,4cyclictest396773-21kworker/u8:1+flush-8:023:46:260
132060992522,2cyclictest263816-21fschecks_time21:21:122
132060992522,2cyclictest263816-21fschecks_time21:21:122
132060992521,2cyclictest204469-21cpuspeed_turbos20:21:092
132060992517,6cyclictest158917-21munin-plugin-st19:35:002
132060992513,9cyclictest280-21systemd-journal19:20:012
13206099250,9cyclictest234502-21sed20:51:132
13206099250,8cyclictest1-21systemd21:50:012
13206099250,14cyclictest311823-21ntpq22:06:202
132054992521,2cyclictest0-21swapper/021:21:210
132054992521,2cyclictest0-21swapper/021:21:200
3757062240,3sleep3451irq_work/323:11:163
13206099245,4cyclictest0-21swapper/220:36:122
13206099242,4cyclictest0-21swapper/200:10:002
132060992419,3cyclictest209449-21fschecks_count20:26:112
132060992419,3cyclictest194392-21aten2_r5power_e20:11:082
13206099241,6cyclictest224007-21apt-get20:41:062
132060992411,9cyclictest387377-21apt-get23:26:062
13206099241,11cyclictest460962-21ntpq00:36:192
132060992320,2cyclictest318394-21cpuspeed_turbos22:16:092
132060992319,3cyclictest371rcuc/223:22:242
132060992319,3cyclictest238837-21aten2_r5power_c20:56:082
132060992319,2cyclictest432349-21aten2_r5power_v00:11:082
132060992313,8cyclictest421748-21turbostat.cron00:00:002
132060992312,2cyclictest161rcu_preempt22:02:492
132060992311,2cyclictest161rcu_preempt00:01:122
13206099230,6cyclictest395618-21cut23:31:172
13206099230,5cyclictest176340-21cut19:51:152
13205499232,20cyclictest0-21swapper/023:36:250
132054992317,4cyclictest194230-21kworker/u8:2+flush-8:020:16:160
132054992314,7cyclictest337905-21/usr/sbin/munin22:36:180
13206099226,2cyclictest161rcu_preempt00:31:212
13206099225,5cyclictest0-21swapper/222:46:132
13206099223,2cyclictest0-21swapper/221:19:082
13206099223,2cyclictest0-21swapper/221:19:082
13206099222,10cyclictest0-21swapper/221:37:302
132060992218,2cyclictest446432-21unixbench_multi00:21:242
132060992217,3cyclictest287870-21apt21:45:002
132060992212,5cyclictest372529-21apt-get23:11:072
132054992217,4cyclictest436560-21unixbench_singl00:11:270
132054992217,4cyclictest132166-21kworker/u8:0+flush-8:020:00:500
13206099215,3cyclictest336810-21ntpq22:31:222
13206099212,5cyclictest0-21swapper/221:56:102
13206099212,3cyclictest0-21swapper/221:53:112
132060992117,3cyclictest2130967-21sshd19:14:192
132060992117,2cyclictest149383-21aten2_r5power_e19:26:062
132060992114,5cyclictest332691-21cat22:30:002
13206099211,11cyclictest39-21ksoftirqd/219:46:132
132060992110,5cyclictest313001-21apt-get22:11:072
132060992110,2cyclictest161rcu_preempt22:21:432
13206099210,11cyclictest203300-21python320:16:252
132054992111,8cyclictest442423-21diskstats00:21:080
132054992111,7cyclictest352754-21apt-get22:51:090
1317162214,11sleep10-21swapper/119:08:101
1272222213,9sleep30-21swapper/319:05:023
13206099207,2cyclictest161rcu_preempt23:36:082
13206099205,5cyclictest0-21swapper/223:46:182
13206099203,4cyclictest0-21swapper/222:42:052
132060992017,2cyclictest371rcuc/222:35:132
13206099201,6cyclictest39-21ksoftirqd/223:51:092
132060992010,2cyclictest161rcu_preempt19:56:082
13206099200,5cyclictest1-21systemd19:45:002
132054992017,2cyclictest301871-21needreboot21:56:200
132054992016,3cyclictest194230-21kworker/u8:2+events_unbound21:26:260
3582392190,4sleep3481ktimers/322:56:113
2886362190,2sleep3481ktimers/321:46:133
13206099194,4cyclictest0-21swapper/223:06:072
13205499191,16cyclictest402546-21diskstats23:41:100
1274402193,9sleep20-21swapper/219:06:102
13206099180,6cyclictest39-21ksoftirqd/222:56:162
4022722152,8sleep30-21swapper/323:41:073
3664122145,5sleep30-21swapper/323:01:223
1487472142,7sleep30-21swapper/319:25:013
4259102132,7sleep30-21swapper/300:01:213
4216572133,6sleep30-21swapper/323:59:003
3911122133,6sleep30-21swapper/323:26:183
3693042133,6sleep30-21swapper/323:06:153
3376252132,6sleep30-21swapper/322:35:023
2869092133,6sleep30-21swapper/321:41:213
2733542132,7sleep30-21swapper/321:31:093
2352142132,7sleep30-21swapper/320:51:173
2293352132,7sleep30-21swapper/320:46:113
1641962132,7sleep30-21swapper/319:41:063
4572372122,6sleep30-21swapper/300:36:083
4468022122,5sleep30-21swapper/300:25:013
4370132122,5sleep30-21swapper/300:15:023
4316812122,6sleep30-21swapper/300:07:193
4119182122,6sleep30-21swapper/323:50:023
3960742122,6sleep30-21swapper/323:31:203
3828762122,6sleep30-21swapper/323:21:123
3474722122,6sleep30-21swapper/322:45:013
3330222122,6sleep30-21swapper/322:31:083
3190562122,6sleep30-21swapper/322:16:153
3132492122,6sleep30-21swapper/322:11:103
3081042122,6sleep30-21swapper/322:06:083
2970152122,6sleep30-21swapper/321:51:243
2721202122,6sleep30-21swapper/321:26:203
2538552122,6sleep30-21swapper/321:11:113
2538552122,6sleep30-21swapper/321:11:103
2437632122,6sleep30-21swapper/321:01:083
2139402122,5sleep30-21swapper/320:30:023
1928732122,6sleep30-21swapper/320:06:183
1842612122,6sleep30-21swapper/320:01:093
1779312122,7sleep30-21swapper/319:51:213
1735152122,6sleep30-21swapper/319:46:283
1588992120,8sleep30-21swapper/319:35:003
4568562112,5sleep30-21swapper/300:34:363
4322422112,5sleep30-21swapper/300:11:083
4071932112,5sleep30-21swapper/323:45:563
3774372112,5sleep30-21swapper/323:16:073
3526432112,5sleep30-21swapper/322:50:033
3478342112,5sleep30-21swapper/322:46:093
3279532112,5sleep30-21swapper/322:25:033
3272742112,5sleep30-21swapper/322:21:293
3030252112,5sleep30-21swapper/322:00:023
2994432112,5sleep30-21swapper/321:56:173
2782062112,5sleep30-21swapper/321:35:033
2678492113,5sleep30-21swapper/321:22:143
2678492113,5sleep30-21swapper/321:22:143
2585482112,6sleep30-21swapper/321:16:093
2585482112,6sleep30-21swapper/321:16:093
2483562112,5sleep30-21swapper/321:05:013
2390502112,5sleep30-21swapper/320:56:103
2236872112,5sleep30-21swapper/320:40:013
2190552112,5sleep30-21swapper/320:36:083
2051422112,5sleep30-21swapper/320:21:143
1992732112,5sleep30-21swapper/320:16:093
1942242112,5sleep30-21swapper/320:10:033
1801982112,5sleep30-21swapper/319:56:153
1597322112,5sleep30-21swapper/319:36:133
1532322112,5sleep30-21swapper/319:26:213
1391532112,5sleep30-21swapper/319:16:053
1321622113,5sleep30-21swapper/319:10:043
2090532102,5sleep30-21swapper/320:25:043
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional