You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-05 - 11:14

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackeslot4s.osadl.org (updated Sun Apr 05, 2026 00:44:05)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
970290994238,3cyclictest1017352-21kworker/u8:0+flush-259:020:15:200
970299993933,4cyclictest1146491-21ntpq21:55:201
970299993630,4cyclictest1152764-21apt-get22:05:111
970306993429,3cyclictest1272630-21base6400:00:003
970306993427,5cyclictest1251601-21latency_hist23:40:003
970299993429,4cyclictest1293809-21/usr/sbin/munin00:20:171
970302993326,4cyclictest1183419-21http22:35:012
970302993326,4cyclictest1173338-21/usr/sbin/munin22:25:132
970299993327,4cyclictest1293143-21latency_hist00:20:001
970299993326,5cyclictest1161871-21ntpq22:10:191
970299993228,3cyclictest75-21kswapd019:30:021
970299993226,4cyclictest1272277-21base6400:00:001
970299993126,4cyclictest1256973-21/usr/sbin/munin23:45:141
970290993127,3cyclictest1246436-21kworker/u8:0+flush-259:023:55:010
970290993127,3cyclictest1125984-21kworker/u8:1+flush-259:022:00:260
970306993026,2cyclictest1074494-21kworker/u8:3+events_unbound21:15:133
970290993024,4cyclictest1246415-21latency_hist23:35:000
970306992925,3cyclictest1178236-21kworker/u8:2+flush-259:023:40:293
970302992925,3cyclictest1178236-21kworker/u8:2+flush-259:000:15:242
970299992925,3cyclictest1048816-21apt-get20:25:131
970299992921,6cyclictest1214311-21ntpq23:00:221
970290992925,3cyclictest1089725-21kworker/u8:4+flush-259:021:30:250
970306992824,3cyclictest509-21rs:main3
970306992823,3cyclictest1184061-21/usr/sbin/munin22:35:193
970302992824,3cyclictest1089725-21kworker/u8:4+events_unbound21:20:182
970302992822,4cyclictest252-21systemd-journal23:50:002
970290992823,4cyclictest990928-21latency_hist19:30:010
970290992823,3cyclictest1272956-21diskstats00:00:130
970302992723,3cyclictest1017352-21kworker/u8:0+flush-259:020:30:172
970302992722,4cyclictest1063988-21kworker/u8:1+flush-259:020:40:142
970306992622,3cyclictest980626-21kworker/u8:2+flush-259:019:50:213
970306992622,3cyclictest1059090-21apt-get20:35:103
970299992621,4cyclictest1132150-21/usr/sbin/munin21:45:131
970299992621,4cyclictest1132150-21/usr/sbin/munin21:45:131
970290992623,2cyclictest1178236-21kworker/u8:2+flush-259:023:00:250
970306992521,3cyclictest954713-21kworker/u8:3+flush-259:019:35:013
970306992521,3cyclictest1230589-21apt-get23:20:003
970306992519,4cyclictest1115658-21latency_hist21:30:003
970302992519,4cyclictest1297798-21ntpq00:20:242
970290992520,3cyclictest1125984-21kworker/u8:1+flush-259:022:20:150
970290992518,5cyclictest980626-21kworker/u8:2+flush-259:019:40:260
970306992421,2cyclictest1033293-21apt-get20:10:113
970302992420,3cyclictest1017352-21kworker/u8:0+flush-259:021:05:212
970302992419,4cyclictest1178236-21kworker/u8:2+flush-259:000:05:202
970302992418,4cyclictest509-21rs:main2
970299992421,2cyclictest954713-21kworker/u8:3+flush-259:019:20:151
970299992421,2cyclictest1142193-21kworker/u8:2+events_unbound21:55:001
970299992420,3cyclictest1028120-21apt-get20:05:131
970290992418,4cyclictest252-21systemd-journal22:58:460
970306992320,2cyclictest1125984-21kworker/u8:1+flush-259:021:55:153
970306992319,3cyclictest954713-21kworker/u8:3+flush-259:019:40:003
970302992319,3cyclictest1282630-21kworker/u8:0+flush-259:000:40:012
970299992320,2cyclictest1089725-21kworker/u8:4+flush-259:021:45:001
970299992320,2cyclictest1074494-21kworker/u8:3+events_unbound21:25:241
970290992320,2cyclictest1053714-21kworker/u8:2+flush-259:020:40:220
970290992319,3cyclictest1053714-21kworker/u8:2+flush-259:020:50:010
970290992319,3cyclictest1053714-21kworker/u8:2+flush-259:020:35:260
970306992219,2cyclictest1074494-21kworker/u8:3+flush-259:021:10:003
970306992218,3cyclictest1282630-21kworker/u8:0+flush-259:000:25:253
970306992218,3cyclictest1152522-21kworker/u8:3+flush-259:022:25:013
970302992218,3cyclictest1178236-21kworker/u8:2+flush-259:022:55:152
970302992218,3cyclictest1017352-21kworker/u8:0+flush-259:021:15:002
970302992216,4cyclictest1074494-21kworker/u8:3+flush-259:021:15:272
970302992215,5cyclictest1308116-21ntpq00:30:222
970299992218,3cyclictest1199960-21apt-get22:50:111
970299992218,3cyclictest1168178-21/usr/sbin/munin22:20:131
970290992219,2cyclictest1178236-21kworker/u8:2+flush-259:000:05:010
970290992218,3cyclictest1017352-21kworker/u8:0+flush-259:021:35:250
970290992217,4cyclictest1178236-21kworker/u8:2+flush-259:023:55:170
970290992216,4cyclictest1288245-21apt-get00:15:120
970306992118,2cyclictest1178236-21kworker/u8:2+events_unbound23:30:223
970306992118,2cyclictest1017352-21kworker/u8:0+flush-259:021:35:213
970306992117,3cyclictest1125984-21kworker/u8:1+events_unbound22:15:203
970306992114,5cyclictest1281899-21ntpq00:05:213
970299992118,2cyclictest1178236-21kworker/u8:2+flush-259:000:10:201
970299992118,2cyclictest1152522-21kworker/u8:3+events_unbound22:35:231
970299992115,4cyclictest252-21systemd-journal23:10:001
970306992017,2cyclictest1189638-21irqcore22:40:153
970306992017,2cyclictest1167984-21kworker/u8:0+flush-259:022:50:213
970306992016,3cyclictest1017352-21kworker/u8:0+flush-259:020:00:173
970306992015,4cyclictest1157686-21latency_hist22:10:013
970302992016,3cyclictest1152522-21kworker/u8:3+flush-259:022:20:262
970302992015,3cyclictest1017352-21kworker/u8:0+flush-259:020:10:162
970302992014,5cyclictest252-21systemd-journal19:45:002
970302992014,4cyclictest1084803-21/usr/sbin/munin21:00:152
970299992017,2cyclictest980626-21kworker/u8:2+flush-259:019:45:231
970299992017,2cyclictest937789-21kworker/u8:1+flush-259:019:55:211
970299992014,5cyclictest1125984-21kworker/u8:1+flush-259:022:25:161
970290992016,3cyclictest1142193-21kworker/u8:2+flush-259:022:05:150
970290992015,3cyclictest1027846-21latency_hist20:05:000
970290992015,3cyclictest0-21swapper/022:55:000
97029099200,18cyclictest1-21systemd20:54:450
970306991916,2cyclictest1178236-21kworker/u8:2+flush-259:023:55:223
970306991915,3cyclictest1178236-21kworker/u8:2+events_unbound22:55:213
970306991915,2cyclictest0-21swapper/322:35:013
970302991915,3cyclictest1125984-21kworker/u8:1+flush-259:022:00:162
970302991914,4cyclictest252-21systemd-journal19:54:592
970299991916,2cyclictest954713-21kworker/u8:3+events_unbound19:25:211
970299991916,2cyclictest1178236-21kworker/u8:2+flush-259:023:15:181
970299991916,2cyclictest1089725-21kworker/u8:4+events_unbound21:20:221
970299991915,3cyclictest1199722-21kworker/u8:3+events_unbound23:10:171
970299991915,3cyclictest1017352-21kworker/u8:0+flush-259:020:30:191
970299991915,3cyclictest1017352-21kworker/u8:0+flush-259:020:00:191
970299991914,3cyclictest252-21systemd-journal22:48:451
970299991912,5cyclictest1083645-21ntpq20:55:201
970290991913,4cyclictest970229-21latency_hist19:10:000
970290991912,5cyclictest1255895-21ntpq23:40:220
970290991912,5cyclictest1147361-21latency_hist22:00:000
970306991816,2cyclictest954713-21kworker/u8:3+events_unbound19:20:213
970306991815,3cyclictest1132143-21kworker/u8:0+events_unbound21:45:223
970306991815,3cyclictest1132143-21kworker/u8:0+events_unbound21:45:223
970306991815,2cyclictest980626-21kworker/u8:2+flush-259:019:40:233
970306991815,2cyclictest954713-21kworker/u8:3+events_unbound19:25:183
970306991815,2cyclictest1033014-21cron20:10:003
970306991814,3cyclictest1089725-21kworker/u8:4+events_unbound21:30:193
970306991814,3cyclictest1089725-21kworker/u8:4+events_unbound21:10:253
970306991814,3cyclictest1017352-21kworker/u8:0+flush-259:021:00:263
970306991814,2cyclictest1125984-21kworker/u8:1+flush-259:022:00:183
970302991814,3cyclictest1178236-21kworker/u8:2+flush-259:023:10:262
970302991814,3cyclictest1125984-21kworker/u8:1+flush-259:021:40:162
970302991813,4cyclictest1125984-21kworker/u8:1+flush-259:022:10:262
970302991813,3cyclictest1132004-21base6421:45:012
970302991813,3cyclictest1132004-21base6421:45:012
970299991815,2cyclictest980626-21kworker/u8:2+flush-259:019:50:191
970299991815,2cyclictest1095601-21irqcore21:10:171
970299991815,2cyclictest1017352-21kworker/u8:0+events_unbound21:35:211
970299991813,4cyclictest1235209-21ntpq23:20:191
970290991815,2cyclictest1089725-21kworker/u8:4+flush-259:021:10:260
970290991812,4cyclictest1104410-21ntpq21:15:230
970306991714,2cyclictest937789-21kworker/u8:1+flush-259:019:55:213
970306991714,2cyclictest1017352-21kworker/u8:0+flush-259:020:22:483
970306991713,3cyclictest1053714-21kworker/u8:2+flush-259:020:45:253
970302991713,3cyclictest1178236-21kworker/u8:2+flush-259:022:40:232
970302991712,4cyclictest1017352-21kworker/u8:0+flush-259:020:05:012
970302991711,4cyclictest1266985-21latency_hist23:55:002
970299991715,2cyclictest1236182-21kworker/u8:1+events_unbound23:30:151
970299991714,2cyclictest1089725-21kworker/u8:4+flush-259:021:30:161
970299991714,2cyclictest1074494-21kworker/u8:3+flush-259:021:00:241
970299991713,3cyclictest954713-21kworker/u8:3+events_unbound20:20:171
970299991713,3cyclictest1199722-21kworker/u8:3+events_unbound23:25:221
970290991714,2cyclictest60350irq/132-enp0s29f1:rx-021:51:080
970290991713,3cyclictest1178236-21kworker/u8:2+flush-259:023:20:240
970290991713,3cyclictest1074494-21kworker/u8:3+flush-259:021:40:230
970306991613,2cyclictest1199682-21cron22:50:003
970306991612,3cyclictest1017352-21kworker/u8:0+events_unbound20:30:143
97030299168,6cyclictest1184033-21cp22:35:012
970302991613,2cyclictest0-21swapper/220:55:012
970302991613,1cyclictest1-21systemd20:46:442
970302991612,3cyclictest980626-21kworker/u8:2+flush-259:019:50:002
970302991612,3cyclictest1199722-21kworker/u8:3+flush-259:023:20:002
970302991611,4cyclictest954713-21kworker/u8:3+flush-259:020:25:152
97030299160,14cyclictest1-21systemd20:09:452
970299991613,2cyclictest1104374-21ntp_kernel_pll_21:15:221
970299991613,2cyclictest1063988-21kworker/u8:1+events_unbound20:40:131
970299991613,2cyclictest1017352-21kworker/u8:0+flush-259:020:10:241
970299991613,2cyclictest1006840-21idleruntime-cro19:45:001
970299991612,3cyclictest980626-21kworker/u8:2+flush-259:019:35:201
970299991612,3cyclictest954713-21kworker/u8:3+flush-259:020:16:211
970299991612,3cyclictest1053714-21kworker/u8:2+events_unbound20:35:121
970290991613,2cyclictest60350irq/132-enp0s29f1:rx-000:10:120
970290991613,2cyclictest1183732-21apt-key22:35:010
970290991612,3cyclictest937789-21kworker/u8:1+flush-259:019:15:260
970290991612,2cyclictest60350irq/132-enp0s29f1:rx-022:40:120
970290991610,4cyclictest252-21systemd-journal22:26:450
970306991511,3cyclictest980626-21kworker/u8:2+events_unbound19:45:173
970306991511,3cyclictest1293740-21base6400:20:003
970302991511,3cyclictest980626-21kworker/u8:2+flush-259:019:35:262
970302991511,3cyclictest252-21systemd-journal23:07:242
970302991510,3cyclictest252-21systemd-journal19:30:022
97029999159,4cyclictest1178452-21/usr/sbin/munin22:30:151
970299991511,3cyclictest1282630-21kworker/u8:0+flush-259:000:29:541
970299991511,3cyclictest1074494-21kworker/u8:3+events_unbound20:50:141
970299991510,4cyclictest252-21systemd-journal23:40:001
970290991514,1cyclictest60350irq/132-enp0s29f1:rx-000:20:290
970290991513,2cyclictest60350irq/132-enp0s29f1:rx-021:20:410
970290991513,1cyclictest60350irq/132-enp0s29f1:rx-022:38:070
970290991513,1cyclictest60350irq/132-enp0s29f1:rx-020:30:150
970290991513,1cyclictest60350irq/132-enp0s29f1:rx-019:45:220
970290991513,1cyclictest60350irq/132-enp0s29f1:rx-019:13:010
970290991513,1cyclictest60350irq/132-enp0s29f1:rx-000:25:150
970290991512,2cyclictest60350irq/132-enp0s29f1:rx-023:38:100
970290991512,2cyclictest60350irq/132-enp0s29f1:rx-023:15:210
970290991512,2cyclictest60350irq/132-enp0s29f1:rx-023:05:170
970290991512,2cyclictest60350irq/132-enp0s29f1:rx-020:20:530
970290991512,2cyclictest60350irq/132-enp0s29f1:rx-019:39:060
970306991411,2cyclictest1236822-21irqcore23:25:163
970302991412,1cyclictest0-21swapper/222:00:002
970302991410,3cyclictest1178236-21kworker/u8:2+flush-259:023:42:362
970299991411,2cyclictest1178236-21kworker/u8:2+flush-259:022:55:221
970299991411,2cyclictest1017352-21kworker/u8:0+events_unbound21:05:191
970299991410,3cyclictest975733-21apt-get19:15:121
970290991413,1cyclictest60350irq/132-enp0s29f1:rx-022:15:250
970290991412,2cyclictest60350irq/132-enp0s29f1:rx-000:30:470
970290991412,1cyclictest60350irq/132-enp0s29f1:rx-023:47:570
970290991412,1cyclictest60350irq/132-enp0s29f1:rx-021:05:250
970290991412,1cyclictest60350irq/132-enp0s29f1:rx-020:12:220
970290991412,1cyclictest60350irq/132-enp0s29f1:rx-019:20:120
970290991412,1cyclictest60350irq/132-enp0s29f1:rx-000:35:230
970290991411,2cyclictest60350irq/132-enp0s29f1:rx-023:12:230
970290991411,2cyclictest60350irq/132-enp0s29f1:rx-022:10:110
970290991411,2cyclictest60350irq/132-enp0s29f1:rx-020:55:130
970290991410,3cyclictest954713-21kworker/u8:3+flush-259:019:55:260
970290991410,3cyclictest252-21systemd-journal20:09:460
970290991410,3cyclictest1236182-21kworker/u8:1+flush-259:023:25:100
970290991410,3cyclictest1178236-21kworker/u8:2+flush-259:022:45:230
97030699139,3cyclictest1283034-21/usr/sbin/munin00:10:143
970306991310,2cyclictest1293173-21gpgv00:20:003
970306991310,2cyclictest1068148-21ntp_kernel_err20:40:183
97030299138,4cyclictest1038468-21apt-get20:15:112
970290991310,2cyclictest60350irq/132-enp0s29f1:rx-019:53:000
97030699129,2cyclictest1260988-21ntp_kernel_pll_23:45:213
97030699129,2cyclictest1162318-21unixbench_multi22:10:233
97030699129,2cyclictest1105565-21cpuspeed_turbos21:20:133
97030699129,2cyclictest1017352-21kworker/u8:0+events_unbound20:50:183
97030699128,3cyclictest1220720-21diskstats23:10:133
97030299129,2cyclictest1246934-21fschecks_time23:35:132
97030299129,2cyclictest1089725-21kworker/u8:4+flush-259:021:35:172
97030299128,3cyclictest970526-21apt-get19:10:102
97030299128,3cyclictest1178236-21kworker/u8:2+flush-259:023:15:212
97030299128,3cyclictest1167984-21kworker/u8:0+flush-259:022:50:252
97029999129,2cyclictest1308494-21unixbench_multi00:30:271
97029999126,4cyclictest1262089-21/usr/sbin/munin23:50:161
97029099129,2cyclictest60350irq/132-enp0s29f1:rx-021:45:120
97029099129,2cyclictest60350irq/132-enp0s29f1:rx-021:45:110
970290991211,1cyclictest60350irq/132-enp0s29f1:rx-019:30:110
970290991210,2cyclictest60350irq/132-enp0s29f1:rx-021:29:010
970290991210,1cyclictest60350irq/132-enp0s29f1:rx-020:25:250
97030699118,2cyclictest1074494-21kworker/u8:3+events_unbound21:50:243
97030699117,3cyclictest1178236-21kworker/u8:2+events_unbound23:20:213
97030299118,2cyclictest1299146-21fschecks_count00:25:132
97030299117,3cyclictest937789-21kworker/u8:1+flush-259:019:15:322
97029999118,2cyclictest1152072-21unixbench_singl22:00:251
97029999117,3cyclictest1125984-21kworker/u8:1+flush-259:022:15:201
97029999116,4cyclictest1194163-21gpgv22:45:001
97030699105,4cyclictest121425499ntpq23:00:213
97030299108,1cyclictest1044045-21irqcore20:20:162
97030299108,1cyclictest0-21swapper/223:00:152
97030299107,2cyclictest1163137-21cpuspeed_turbos22:15:132
97029999106,3cyclictest1273053-21fschecks_time00:00:141
97029099105,4cyclictest1088627-21memory21:00:200
9703029996,1cyclictest1112921-21kthreadcore21:25:182
9702999993,4cyclictest1069925-21cut20:45:171
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional