You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-13 - 21:12

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackeslot4s.osadl.org (updated Mon Apr 13, 2026 12:44:06)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1047194994639,5cyclictest1355099-21cp12:05:003
1047188994438,4cyclictest1291725-21kworker/u8:2+flush-259:011:45:202
1047188994135,4cyclictest252-21systemd-journal10:15:202
1047194994034,4cyclictest1360521-21latency_hist12:10:013
1047188994036,3cyclictest1120762-21kworker/u8:2+flush-259:008:16:542
1047188993934,3cyclictest1069157-21/usr/sbin/munin07:30:142
1047188993834,3cyclictest1041835-21kworker/u8:1+events_unbound07:15:232
1047188993831,5cyclictest1104575-21ntpq08:00:202
1047179993833,4cyclictest1381370-21apt-get12:30:120
1047194993632,3cyclictest1047645-21apt-get07:10:113
1047188993632,3cyclictest1323608-21kworker/u8:0+flush-259:011:34:592
1047188993629,4cyclictest252-21systemd-journal11:36:582
1047194993529,4cyclictest252-21systemd-journal10:10:013
1047188993530,3cyclictest1120762-21kworker/u8:2+events_unbound09:20:232
1047188993429,3cyclictest1260662-21kworker/u8:2+flush-259:010:35:262
1047184993430,3cyclictest1147031-21apt-get08:45:091
1047179993430,3cyclictest1041835-21kworker/u8:1+flush-259:008:15:170
1047194993329,3cyclictest1120762-21kworker/u8:2+flush-259:008:40:213
1047188993330,2cyclictest1360539-21kworker/u8:3+flush-259:012:10:202
1047188993327,4cyclictest1120762-21kworker/u8:2+events_unbound09:30:232
1047179993329,3cyclictest1126465-21apt-get08:25:110
1047179993328,3cyclictest1120762-21kworker/u8:2+flush-259:008:20:210
1047188993229,2cyclictest1239991-21kworker/u8:4+flush-259:010:55:152
1047188993229,2cyclictest1120762-21kworker/u8:2+flush-259:009:05:252
1047194993128,2cyclictest1291725-21kworker/u8:2+flush-259:011:25:003
1047188993127,3cyclictest1291725-21kworker/u8:2+flush-259:012:20:162
1047188993127,3cyclictest1229645-21kworker/u8:0+events_unbound10:25:212
1047188993126,3cyclictest1041835-21kworker/u8:1+events_unbound07:20:212
1047179993126,4cyclictest1041835-21kworker/u8:1+flush-259:008:00:210
1047194993027,2cyclictest1308144-21kworker/u8:1+flush-259:011:30:163
1047194993024,4cyclictest1068684-21cp07:30:003
1047188993027,2cyclictest1360539-21kworker/u8:3+flush-259:012:15:202
1047188993025,3cyclictest1323608-21kworker/u8:0+events_unbound12:25:182
1047188993025,3cyclictest1271009-21kworker/u8:3+flush-259:010:45:202
1047184993027,2cyclictest1282247-21kworker/u8:0+flush-259:010:55:261
1047188992923,4cyclictest252-21systemd-journal11:05:002
1047179992926,2cyclictest1058406-21apt-get07:20:110
1047179992924,4cyclictest252-21systemd-journal09:50:010
1047194992823,4cyclictest1244228-21ntpq10:15:223
1047188992825,2cyclictest1120762-21kworker/u8:2+flush-259:009:45:212
1047188992824,3cyclictest1291725-21kworker/u8:2+events_unbound11:25:222
1047188992824,3cyclictest1239991-21kworker/u8:4+flush-259:010:44:592
1047188992824,2cyclictest1151956-21kworker/u8:0+events_unbound09:25:222
1047184992823,4cyclictest1260907-21apt-get10:35:121
1047179992822,4cyclictest252-21systemd-journal10:48:570
1047194992723,3cyclictest1291725-21kworker/u8:2+flush-259:011:25:173
1047188992724,2cyclictest1041835-21kworker/u8:1+flush-259:007:50:152
1047184992724,2cyclictest1120762-21kworker/u8:2+events_unbound09:30:161
1047194992622,3cyclictest1328761-21kworker/u8:1+flush-259:011:50:183
1047194992622,3cyclictest1079293-21kworker/u8:3+flush-259:007:54:553
1047188992623,2cyclictest1120762-21kworker/u8:2+flush-259:008:50:242
1047188992622,3cyclictest1120762-21kworker/u8:2+events_unbound08:21:002
1047188992622,3cyclictest1079293-21kworker/u8:3+events_unbound07:55:142
1047188992619,5cyclictest1354919-21latency_hist12:05:012
1047188992619,5cyclictest1297382-21cp11:09:592
1047184992623,2cyclictest1239991-21kworker/u8:4+flush-259:011:15:151
1047184992623,2cyclictest1183492-21apt-get09:20:131
1047184992623,2cyclictest1120762-21kworker/u8:2+flush-259:010:05:241
1047184992620,4cyclictest1151908-21apt-get08:50:011
1047179992622,3cyclictest1095402-21kworker/u8:0+flush-259:008:05:260
1047179992620,5cyclictest1235210-21diskstats10:10:150
1047179992620,4cyclictest1089566-21latency_hist07:50:000
1047194992522,2cyclictest1229645-21kworker/u8:0+flush-259:010:10:163
1047194992521,3cyclictest1120762-21kworker/u8:2+events_unbound08:20:183
1047188992521,3cyclictest1041835-21kworker/u8:1+flush-259:008:45:222
1047188992520,3cyclictest1193554-21kworker/u8:3+flush-259:009:50:202
1047188992518,3cyclictest1052562-21kworker/u8:0+events_unbound07:25:222
1047184992520,4cyclictest1328761-21kworker/u8:1+flush-259:011:40:171
1047194992421,2cyclictest1239991-21kworker/u8:4+flush-259:010:34:593
1047194992421,2cyclictest1151956-21kworker/u8:0+events_unbound08:50:243
1047194992418,4cyclictest1270083-21ntpq10:40:223
1047188992421,2cyclictest1183251-21kworker/u8:1+events_unbound10:51:582
1047188992421,2cyclictest1079293-21kworker/u8:3+events_unbound07:45:142
1047188992420,3cyclictest1229645-21kworker/u8:0+flush-259:010:10:262
1047188992420,3cyclictest1120762-21kworker/u8:2+events_unbound10:07:582
1047188992420,3cyclictest1041835-21kworker/u8:1+events_unbound08:37:582
1047188992420,2cyclictest1120762-21kworker/u8:2+events_unbound09:00:142
1047184992421,2cyclictest1291725-21kworker/u8:2+flush-259:011:45:171
1047184992420,3cyclictest1239991-21kworker/u8:4+events_unbound11:05:011
1047184992420,3cyclictest1151956-21kworker/u8:0+flush-259:009:25:151
1047184992419,3cyclictest1084657-21apt-get07:45:121
1047184992419,3cyclictest1063559-21/usr/sbin/munin07:25:141
1047179992416,6cyclictest1343685-21ntpq11:50:220
1047194992318,3cyclictest1047342-21cat07:10:023
1047188992320,2cyclictest1380720-21kworker/u8:4+flush-259:012:30:162
1047188992319,3cyclictest1328761-21kworker/u8:1+events_unbound11:40:192
1047188992319,3cyclictest1291725-21kworker/u8:2+events_unbound11:50:142
1047188992319,3cyclictest1151956-21kworker/u8:0+events_unbound09:15:282
1047188992319,3cyclictest1120762-21kworker/u8:2+events_unbound08:25:132
1047188992317,4cyclictest1095402-21kworker/u8:0+events_unbound08:09:592
1047184992320,2cyclictest1183251-21kworker/u8:1+flush-259:010:00:001
1047184992319,3cyclictest252-21systemd-journal09:16:571
1047194992218,3cyclictest1323608-21kworker/u8:0+events_unbound12:25:253
1047194992218,3cyclictest1323608-21kworker/u8:0+events_unbound12:20:223
1047194992218,3cyclictest1041835-21kworker/u8:1+events_unbound07:25:003
1047188992219,2cyclictest1380720-21kworker/u8:4+events_unbound12:35:212
1047188992218,3cyclictest1323608-21kworker/u8:0+flush-259:011:55:162
1047188992217,4cyclictest1328761-21kworker/u8:1+events_unbound12:09:592
1047188992214,6cyclictest1084391-21turbostat07:44:592
1047194992117,3cyclictest1380720-21kworker/u8:4+events_unbound12:35:233
1047194992116,3cyclictest1255496-21latency_hist10:30:003
1047188992117,3cyclictest1193554-21kworker/u8:3+events_unbound09:59:592
1047188992117,3cyclictest1120762-21kworker/u8:2+events_unbound09:10:112
1047184992118,2cyclictest1095402-21kworker/u8:0+flush-259:008:10:211
1047184992118,2cyclictest1041835-21kworker/u8:1+flush-259:008:15:251
1047184992117,3cyclictest1323608-21kworker/u8:0+events_unbound12:20:241
1047179992118,2cyclictest1183251-21kworker/u8:1+flush-259:011:00:150
1047179992117,3cyclictest1041835-21kworker/u8:1+flush-259:007:35:250
1047179992115,4cyclictest252-21systemd-journal09:52:570
1047179992115,4cyclictest252-21systemd-journal08:00:010
1047194992017,2cyclictest1193554-21kworker/u8:3+flush-259:010:00:213
1047194992016,3cyclictest1308106-21latency_hist11:20:013
1047194992016,3cyclictest1120762-21kworker/u8:2+events_unbound08:35:213
1047194992016,3cyclictest1052562-21kworker/u8:0+flush-259:007:34:593
1047194992014,4cyclictest1280542-21ntpq10:50:213
1047188992016,3cyclictest1120762-21kworker/u8:2+flush-259:008:34:562
1047184992017,2cyclictest1323608-21kworker/u8:0+events_unbound12:25:231
1047184992017,2cyclictest1281387-21apt-get10:54:591
1047184992017,2cyclictest1239991-21kworker/u8:4+events_unbound11:29:591
1047184992017,2cyclictest1-21systemd11:35:001
1047184992017,2cyclictest1120762-21kworker/u8:2+events_unbound08:30:281
1047184992017,2cyclictest1052562-21kworker/u8:0+events_unbound07:15:141
1047184992016,3cyclictest1328761-21kworker/u8:1+events_unbound11:50:021
1047184992016,3cyclictest1120762-21kworker/u8:2+events_unbound10:20:221
1047184992014,4cyclictest252-21systemd-journal07:14:521
1047179992016,3cyclictest1260662-21kworker/u8:2+flush-259:010:35:240
1047194991916,2cyclictest1120762-21kworker/u8:2+events_unbound09:05:233
1047188991916,2cyclictest1239991-21kworker/u8:4+flush-259:010:30:272
1047188991916,2cyclictest1239991-21kworker/u8:4+events_unbound11:15:212
1047188991916,2cyclictest1193554-21kworker/u8:3+flush-259:010:20:172
1047188991915,3cyclictest1239991-21kworker/u8:4+flush-259:011:10:262
1047188991915,3cyclictest1239991-21kworker/u8:4+flush-259:011:10:262
1047188991915,3cyclictest1041835-21kworker/u8:1+flush-259:007:10:212
1047184991916,2cyclictest1291725-21kworker/u8:2+flush-259:011:20:211
1047184991915,3cyclictest1328761-21kworker/u8:1+flush-259:012:05:211
1047184991915,3cyclictest1239991-21kworker/u8:4+events_unbound11:05:221
1047179991914,3cyclictest252-21systemd-journal11:55:370
1047179991913,4cyclictest1046922-21apt-get07:10:010
1047194991815,2cyclictest1041835-21kworker/u8:1+flush-259:008:10:053
1047194991814,3cyclictest507-21in:imuxsock07:20:003
1047194991814,3cyclictest1328761-21kworker/u8:1+events_unbound11:40:253
1047194991814,3cyclictest1281944-21gpgv10:55:003
1047188991814,3cyclictest1120762-21kworker/u8:2+events_unbound08:40:582
1047188991814,3cyclictest1041835-21kworker/u8:1+events_unbound07:36:532
1047184991815,2cyclictest1323608-21kworker/u8:0+events_unbound12:00:131
1047184991815,2cyclictest1282247-21kworker/u8:0+flush-259:011:15:001
1047184991815,2cyclictest1282247-21kworker/u8:0+flush-259:011:15:001
1047184991815,2cyclictest1120762-21kworker/u8:2+flush-259:009:40:201
1047184991815,2cyclictest1120762-21kworker/u8:2+events_unbound09:35:201
1047184991815,2cyclictest1095402-21kworker/u8:0+flush-259:008:05:201
1047184991814,3cyclictest1041835-21kworker/u8:1+flush-259:007:20:241
1047179991815,2cyclictest1068787-21apt-config07:30:010
1047179991814,3cyclictest1193554-21kworker/u8:3+events_unbound10:20:200
1047179991812,4cyclictest252-21systemd-journal12:40:000
1047194991714,2cyclictest1291725-21kworker/u8:2+flush-259:011:35:163
1047194991714,2cyclictest1239991-21kworker/u8:4+events_unbound11:10:233
1047194991714,2cyclictest1239991-21kworker/u8:4+events_unbound11:10:223
1047194991714,2cyclictest1151956-21kworker/u8:0+events_unbound09:25:153
1047194991713,3cyclictest1120762-21kworker/u8:2+flush-259:008:25:593
1047194991712,4cyclictest1203877-21latency_hist09:40:013
1047184991714,2cyclictest1193554-21kworker/u8:3+flush-259:009:50:171
1047184991714,2cyclictest1183251-21kworker/u8:1+flush-259:010:40:271
1047184991714,2cyclictest1120762-21kworker/u8:2+flush-259:009:00:101
1047184991714,2cyclictest1120762-21kworker/u8:2+flush-259:008:25:161
1047184991713,3cyclictest1360539-21kworker/u8:3+events_unbound12:34:571
1047184991713,3cyclictest1344147-21kworker/u8:3+events_unbound11:55:151
1047184991712,3cyclictest252-21systemd-journal12:36:571
1047179991714,2cyclictest60350irq/132-enp0s29f1:rx-012:25:130
1047179991714,2cyclictest60350irq/132-enp0s29f1:rx-010:19:480
1047179991714,2cyclictest60350irq/132-enp0s29f1:rx-009:30:170
1047179991714,2cyclictest60350irq/132-enp0s29f1:rx-008:10:440
1047179991714,2cyclictest1120762-21kworker/u8:2+flush-259:008:35:210
1047179991714,2cyclictest1120762-21kworker/u8:2+events_unbound08:40:230
1047179991714,2cyclictest1052562-21kworker/u8:0+flush-259:007:44:410
1047179991714,2cyclictest1041835-21kworker/u8:1+flush-259:008:35:000
1047179991713,3cyclictest1120762-21kworker/u8:2+events_unbound09:35:150
1047194991613,2cyclictest1120762-21kworker/u8:2+flush-259:009:30:193
1047194991613,2cyclictest1120762-21kworker/u8:2+flush-259:009:20:183
1047194991611,4cyclictest1105502-21latency_hist08:05:013
1047188991611,4cyclictest507-21in:imuxsock09:00:012
1047184991612,3cyclictest1183251-21kworker/u8:1+events_unbound10:00:181
1047184991611,3cyclictest1255744-21/usr/sbin/munin10:30:171
1047179991614,1cyclictest60350irq/132-enp0s29f1:rx-008:46:340
1047179991613,2cyclictest60350irq/132-enp0s29f1:rx-012:05:090
1047179991613,2cyclictest60350irq/132-enp0s29f1:rx-011:42:050
1047179991613,2cyclictest60350irq/132-enp0s29f1:rx-011:20:230
1047179991613,2cyclictest60350irq/132-enp0s29f1:rx-010:25:240
1047179991613,2cyclictest60350irq/132-enp0s29f1:rx-009:14:050
1047179991612,3cyclictest1183251-21kworker/u8:1+flush-259:010:50:200
1047194991512,2cyclictest1282247-21kworker/u8:0+flush-259:011:00:243
1047194991512,2cyclictest1041835-21kworker/u8:1+flush-259:008:45:173
1047194991511,3cyclictest1193554-21kworker/u8:3+events_unbound09:55:233
1047188991512,2cyclictest1291725-21kworker/u8:2+events_unbound11:20:222
1047188991511,3cyclictest1193554-21kworker/u8:3+events_unbound09:36:042
1047188991511,3cyclictest1120762-21kworker/u8:2+events_unbound09:41:262
1047188991510,3cyclictest1041835-21kworker/u8:1+events_unbound08:10:182
1047184991512,2cyclictest1074061-21sh07:34:591
1047184991511,3cyclictest1120762-21kworker/u8:2+flush-259:009:10:151
1047184991511,3cyclictest1120762-21kworker/u8:2+flush-259:008:40:181
1047184991511,3cyclictest1120762-21kworker/u8:2+flush-259:008:20:201
1047184991511,3cyclictest1120762-21kworker/u8:2+events_unbound09:09:541
1047184991511,3cyclictest1052562-21kworker/u8:0+flush-259:007:35:131
1047179991513,1cyclictest60350irq/132-enp0s29f1:rx-011:09:360
1047179991513,1cyclictest60350irq/132-enp0s29f1:rx-010:30:200
1047179991513,1cyclictest60350irq/132-enp0s29f1:rx-010:02:070
1047179991513,1cyclictest60350irq/132-enp0s29f1:rx-009:00:240
1047179991513,1cyclictest60350irq/132-enp0s29f1:rx-007:50:230
1047179991512,2cyclictest60350irq/132-enp0s29f1:rx-012:15:220
1047179991512,2cyclictest60350irq/132-enp0s29f1:rx-011:33:160
1047179991512,2cyclictest60350irq/132-enp0s29f1:rx-010:40:130
1047179991512,2cyclictest60350irq/132-enp0s29f1:rx-009:41:270
1047179991512,2cyclictest60350irq/132-enp0s29f1:rx-008:55:140
1047179991511,3cyclictest60350irq/132-enp0s29f1:rx-011:30:000
1047179991511,3cyclictest1334553-21apt-get11:45:120
1047194991411,2cyclictest1360539-21kworker/u8:3+events_unbound12:15:163
1047194991411,2cyclictest1178074-21sh09:15:013
1047194991411,2cyclictest1120762-21kworker/u8:2+flush-259:009:00:183
1047194991411,2cyclictest1041835-21kworker/u8:1+events_unbound08:15:133
1047194991411,2cyclictest1041835-21kworker/u8:1+events_unbound07:40:213
1047194991410,3cyclictest1052562-21kworker/u8:0+flush-259:007:35:183
104719499140,4cyclictest11087531kthreadcore08:05:183
104718499149,4cyclictest1324250-21apt-get11:35:111
1047184991412,1cyclictest0-21swapper/107:55:001
1047184991411,2cyclictest252-21systemd-journal08:00:001
1047184991411,2cyclictest1366335-21irqcore12:15:171
1047184991411,2cyclictest1235270-21fschecks_time10:10:141
1047184991411,2cyclictest1041835-21kworker/u8:1+events_unbound07:40:151
1047184991410,3cyclictest1157749-21apt-get08:55:131
104717999148,4cyclictest252-21systemd-journal08:50:580
1047179991412,1cyclictest60350irq/132-enp0s29f1:rx-012:14:220
1047179991412,1cyclictest60350irq/132-enp0s29f1:rx-011:38:350
1047179991412,1cyclictest60350irq/132-enp0s29f1:rx-011:16:190
1047179991412,1cyclictest60350irq/132-enp0s29f1:rx-010:09:370
1047179991412,1cyclictest60350irq/132-enp0s29f1:rx-009:25:150
1047179991412,1cyclictest60350irq/132-enp0s29f1:rx-007:30:130
1047179991411,2cyclictest60350irq/132-enp0s29f1:rx-011:00:000
1047179991411,2cyclictest60350irq/132-enp0s29f1:rx-009:15:270
1047179991411,2cyclictest60350irq/132-enp0s29f1:rx-007:15:070
104719499139,3cyclictest1328761-21kworker/u8:1+flush-259:011:55:253
104719499139,3cyclictest1100334-21cron07:59:593
1047194991311,1cyclictest1209015-21sh09:45:013
1047194991311,1cyclictest0-21swapper/312:10:233
1047194991310,2cyclictest1079293-21kworker/u8:3+flush-259:007:45:203
1047184991311,1cyclictest1251005-21irqcore10:25:161
1047184991311,1cyclictest1120762-21kworker/u8:2+events_unbound08:35:161
1047184991310,3cyclictest1229645-21kworker/u8:0+events_unbound10:15:151
1047184991310,2cyclictest1120762-21kworker/u8:2+flush-259:009:45:201
1047179991312,1cyclictest60350irq/132-enp0s29f1:rx-009:07:120
1047179991311,1cyclictest60350irq/132-enp0s29f1:rx-012:20:240
1047179991311,1cyclictest60350irq/132-enp0s29f1:rx-011:12:360
1047179991311,1cyclictest60350irq/132-enp0s29f1:rx-011:12:350
1047179991311,1cyclictest60350irq/132-enp0s29f1:rx-009:55:180
1047179991310,2cyclictest60350irq/132-enp0s29f1:rx-012:00:200
104719499129,2cyclictest1161676-21needreboot08:55:223
104718499129,2cyclictest1100810-21fschecks_count08:00:141
104718499128,3cyclictest0-21swapper/112:10:171
104719499119,1cyclictest0-21swapper/308:30:153
104719499118,2cyclictest1183251-21kworker/u8:1+events_unbound11:05:173
104719499118,2cyclictest1120762-21kworker/u8:2+events_unbound09:15:143
104718899118,1cyclictest0-21swapper/207:10:022
104719499106,3cyclictest1120762-21kworker/u8:2+flush-259:009:50:253
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional