You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-24 - 19:52

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackeslot4s.osadl.org (updated Thu Sep 24, 2026 12:44:06)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
903161995753,3cyclictest75-21kswapd011:37:132
903156995751,4cyclictest1188983-21latency_hist11:45:000
903156995650,4cyclictest1085411-21apt-get10:05:110
903156995650,4cyclictest1085411-21apt-get10:05:110
903158995349,3cyclictest1090575-21apt-get10:10:161
903166995148,2cyclictest1152543-21kworker/u8:2+flush-259:011:15:213
903161994944,4cyclictest903375-21apt-get07:10:132
903158994943,4cyclictest1084284-21ntpq10:00:211
903156994945,3cyclictest1200283-21journal-offline11:55:130
903166994744,2cyclictest939204-21kworker/u8:3+flush-259:008:00:253
903166994643,2cyclictest1162032-21kworker/u8:0+flush-259:011:25:223
903156994640,4cyclictest335557-21systemd-journal08:55:130
903166994441,2cyclictest1152543-21kworker/u8:2+flush-259:011:15:013
903161994439,4cyclictest965687-21apt-get08:10:112
903166994340,2cyclictest1121373-21kworker/u8:3+events_unbound11:50:263
903166994339,3cyclictest1121373-21kworker/u8:3+events_unbound11:30:233
903166994238,3cyclictest1199968-21kworker/u8:4+flush-259:012:20:213
903166994238,3cyclictest1199968-21kworker/u8:4+flush-259:012:20:203
903161994138,2cyclictest959831-21kworker/u8:2+flush-259:008:45:112
903161994138,2cyclictest1043691-21kworker/u8:0+flush-259:009:55:002
903161994137,3cyclictest898199-21kworker/u8:0+flush-259:009:05:262
903158994138,2cyclictest1100329-21kworker/u8:3+flush-259:010:25:001
903161994034,4cyclictest1038824-21cat09:20:002
903158994036,3cyclictest1105814-21kworker/u8:2+flush-259:010:30:281
903156994035,4cyclictest1167934-21gpgv11:25:010
903166993935,3cyclictest1105814-21kworker/u8:2+events_unbound10:25:103
903166993935,3cyclictest1043691-21kworker/u8:0+flush-259:009:50:203
903161993936,3cyclictest898199-21kworker/u8:0+events_unbound09:00:182
903161993834,3cyclictest1043691-21kworker/u8:0+events_unbound10:10:252
903166993733,3cyclictest1043691-21kworker/u8:0+flush-259:009:35:183
903161993734,2cyclictest1115777-21kworker/u8:0+events_unbound10:45:222
903158993732,4cyclictest898199-21kworker/u8:0+flush-259:007:10:261
903158993732,3cyclictest1173777-21apt-get11:30:141
903156993731,4cyclictest1022429-21base6409:05:010
903166993633,2cyclictest1079998-21kworker/u8:2+flush-259:010:10:293
903166993632,3cyclictest898199-21kworker/u8:0+events_unbound08:45:013
903161993631,3cyclictest335557-21systemd-journal08:10:012
903158993631,3cyclictest1131926-21apt-get10:50:171
903158993630,4cyclictest1038320-21gpgv09:20:001
903166993532,2cyclictest1194359-21kworker/u8:0+flush-259:011:55:173
903161993530,3cyclictest1220704-21/usr/sbin/munin12:15:132
903161993530,3cyclictest1220704-21/usr/sbin/munin12:15:122
903158993532,2cyclictest981183-21kworker/u8:1+flush-259:008:50:221
903158993532,2cyclictest1178871-21kworker/u8:1+flush-259:012:10:211
903166993431,2cyclictest859661-21kworker/u8:1+flush-259:007:35:213
903166993431,2cyclictest1142406-21kworker/u8:1+flush-259:011:05:203
903166993431,2cyclictest1131882-21kworker/u8:1+flush-259:010:50:293
903166993430,3cyclictest1043691-21kworker/u8:0+flush-259:009:55:163
903161993430,3cyclictest1100329-21kworker/u8:3+events_unbound10:20:242
903161993430,3cyclictest1044028-21apt-get09:25:122
903158993431,2cyclictest1121373-21kworker/u8:3+events_unbound11:20:131
903156993430,3cyclictest1043691-21kworker/u8:0+events_unbound09:50:120
903156993428,3cyclictest1235982-21latency_hist12:30:000
903166993330,2cyclictest981183-21kworker/u8:1+flush-259:008:55:213
903161993330,2cyclictest981183-21kworker/u8:1+events_unbound08:55:162
903161993330,2cyclictest939204-21kworker/u8:3+events_unbound08:00:202
903161993329,3cyclictest1115777-21kworker/u8:0+flush-259:010:35:212
903158993330,2cyclictest1079998-21kworker/u8:2+flush-259:010:15:171
903158993329,3cyclictest898199-21kworker/u8:0+flush-259:008:55:251
903158993329,3cyclictest1199968-21kworker/u8:4+flush-259:012:15:171
903158993329,3cyclictest1199968-21kworker/u8:4+flush-259:012:15:161
903166993229,2cyclictest1121373-21kworker/u8:3+flush-259:011:40:213
903166993228,3cyclictest1121373-21kworker/u8:3+events_unbound11:35:113
903156993227,4cyclictest1215564-21apt-get12:10:170
903166993128,2cyclictest965652-21kworker/u8:3+flush-259:008:10:243
903166993125,2cyclictest981183-21kworker/u8:1+events_unbound09:15:233
903161993128,2cyclictest1079998-21kworker/u8:2+events_unbound10:15:252
903161993126,4cyclictest1001608-21latency_hist08:45:012
903158993127,3cyclictest1043691-21kworker/u8:0+flush-259:009:40:171
903156993126,4cyclictest1049248-21apt-get09:30:110
903166993027,2cyclictest981183-21kworker/u8:1+events_unbound08:35:223
903166993027,2cyclictest959831-21kworker/u8:2+flush-259:008:05:213
903166993027,2cyclictest959831-21kworker/u8:2+events_unbound08:15:233
903166993027,2cyclictest898199-21kworker/u8:0+events_unbound09:00:243
903166993027,2cyclictest1105814-21kworker/u8:2+flush-259:010:35:013
903161993027,2cyclictest898199-21kworker/u8:0+flush-259:007:45:242
903161993026,3cyclictest1142406-21kworker/u8:1+flush-259:011:10:002
903161993025,3cyclictest1188984-21apt-get11:44:592
903156993026,3cyclictest859661-21kworker/u8:1+flush-259:007:30:150
903156993025,4cyclictest898199-21kworker/u8:0+events_unbound09:10:130
903156993024,4cyclictest1156671-21ntpq11:10:230
903166992926,2cyclictest898199-21kworker/u8:0+events_unbound07:10:213
903166992926,2cyclictest859661-21kworker/u8:1+flush-259:007:30:203
903161992926,2cyclictest898199-21kworker/u8:0+flush-259:008:25:212
903161992926,2cyclictest1178871-21kworker/u8:1+flush-259:012:05:162
903161992925,3cyclictest1043999-21kworker/u8:4+flush-259:009:35:202
903161992922,6cyclictest1121771-21diskstats10:40:132
903158992925,3cyclictest859661-21kworker/u8:1+flush-259:007:20:131
903158992925,3cyclictest859661-21kworker/u8:1+events_unbound07:55:151
903158992925,3cyclictest1199968-21kworker/u8:4+flush-259:012:35:241
903158992925,3cyclictest1152543-21kworker/u8:2+events_unbound11:15:201
903158992924,3cyclictest898199-21kworker/u8:0+flush-259:008:25:251
903158992923,4cyclictest335557-21systemd-journal11:49:131
903156992925,3cyclictest1121373-21kworker/u8:3+flush-259:010:50:270
903166992825,2cyclictest1142406-21kworker/u8:1+events_unbound11:00:213
903161992824,3cyclictest898199-21kworker/u8:0+events_unbound08:20:132
903158992825,2cyclictest1115777-21kworker/u8:0+flush-259:010:35:151
903158992825,2cyclictest1043691-21kworker/u8:0+events_unbound09:35:151
903158992823,4cyclictest959831-21kworker/u8:2+events_unbound08:35:181
903158992823,3cyclictest929167-21apt-get07:35:121
903156992824,3cyclictest898199-21kworker/u8:0+events_unbound07:40:140
903156992823,4cyclictest964984-21apt-get08:10:000
903156992823,3cyclictest335557-21systemd-journal08:25:180
903166992723,3cyclictest1121610-21apt-get10:40:113
903161992723,2cyclictest859661-21kworker/u8:1+flush-259:007:20:172
903158992721,4cyclictest1022936-21apt-get09:05:131
903158992720,5cyclictest1168504-21cat11:25:011
903156992723,3cyclictest898199-21kworker/u8:0+events_unbound08:20:230
903156992723,3cyclictest859661-21kworker/u8:1+events_unbound07:50:130
903156992723,3cyclictest1188639-21kworker/u8:2+flush-259:011:45:510
903166992623,2cyclictest981183-21kworker/u8:1+flush-259:008:50:163
903166992623,2cyclictest898199-21kworker/u8:0+flush-259:008:25:243
903166992622,3cyclictest898199-21kworker/u8:0+events_unbound09:05:243
903166992619,5cyclictest1039055-21diskstats09:20:133
903161992622,3cyclictest981183-21kworker/u8:1+events_unbound08:50:212
903161992622,3cyclictest1121373-21kworker/u8:3+flush-259:011:45:252
903161992622,3cyclictest1121373-21kworker/u8:3+flush-259:010:55:002
903161992622,3cyclictest1105814-21kworker/u8:2+flush-259:010:55:272
903158992623,2cyclictest959831-21kworker/u8:2+events_unbound08:30:201
903158992622,3cyclictest939204-21kworker/u8:3+events_unbound07:50:231
903158992622,3cyclictest898199-21kworker/u8:0+flush-259:007:15:241
903158992622,3cyclictest859661-21kworker/u8:1+events_unbound08:05:221
903158992622,3cyclictest1121373-21kworker/u8:3+events_unbound11:35:251
903158992622,3cyclictest1043691-21kworker/u8:0+events_unbound09:50:141
903158992621,4cyclictest1043691-21kworker/u8:0+flush-259:009:25:251
903158992621,3cyclictest898199-21kworker/u8:0+flush-259:009:10:151
903158992621,3cyclictest509-21rs:main1
903156992623,2cyclictest1043999-21kworker/u8:4+events_unbound09:45:210
903156992622,3cyclictest1043691-21kworker/u8:0+events_unbound09:55:220
903161992522,2cyclictest1194359-21kworker/u8:0+flush-259:012:00:202
903161992522,2cyclictest1121373-21kworker/u8:3+events_unbound11:20:202
903161992521,3cyclictest959831-21kworker/u8:2+flush-259:008:30:212
903161992521,3cyclictest1105814-21kworker/u8:2+events_unbound10:25:202
903158992521,3cyclictest898199-21kworker/u8:0+flush-259:007:40:151
903158992521,3cyclictest1142406-21kworker/u8:1+flush-259:011:05:001
903156992522,2cyclictest1178871-21kworker/u8:1+flush-259:012:20:150
903156992522,2cyclictest1178871-21kworker/u8:1+flush-259:012:20:140
903156992520,4cyclictest1142251-21apt-get11:00:140
903166992422,2cyclictest859661-21kworker/u8:1+events_unbound07:20:153
903166992421,2cyclictest1178871-21kworker/u8:1+events_unbound12:13:563
903166992421,2cyclictest1121373-21kworker/u8:3+flush-259:011:20:163
903166992421,2cyclictest1090328-21kworker/u8:1+flush-259:010:20:343
903166992421,2cyclictest1043691-21kworker/u8:0+events_unbound09:25:263
903166992420,3cyclictest1043691-21kworker/u8:0+events_unbound10:00:273
903161992421,2cyclictest1142406-21kworker/u8:1+events_unbound11:10:192
903161992420,3cyclictest939204-21kworker/u8:3+events_unbound07:50:252
903161992420,3cyclictest898199-21kworker/u8:0+flush-259:009:10:132
903161992420,3cyclictest1043691-21kworker/u8:0+events_unbound10:05:182
903161992420,3cyclictest1043691-21kworker/u8:0+events_unbound10:05:172
903158992421,2cyclictest1178871-21kworker/u8:1+flush-259:012:25:221
903158992420,3cyclictest965652-21kworker/u8:3+events_unbound08:10:221
903158992420,3cyclictest1043691-21kworker/u8:0+events_unbound09:55:201
903156992420,3cyclictest1115777-21kworker/u8:0+flush-259:010:50:000
903156992420,3cyclictest1079998-21kworker/u8:2+events_unbound10:10:280
903166992320,2cyclictest959831-21kworker/u8:2+events_unbound08:30:183
903166992320,2cyclictest923788-21idleruntime-cro07:30:003
903166992320,2cyclictest898199-21kworker/u8:0+flush-259:007:15:153
903166992320,2cyclictest1115777-21kworker/u8:0+events_unbound10:45:113
903166992320,2cyclictest1079998-21kworker/u8:2+flush-259:010:15:193
903166992319,3cyclictest1079998-21kworker/u8:2+events_unbound10:05:113
903166992319,3cyclictest1079998-21kworker/u8:2+events_unbound10:05:113
903161992321,1cyclictest928890-21cron07:35:002
903161992320,2cyclictest1043691-21kworker/u8:0+flush-259:009:40:152
903161992319,3cyclictest898199-21kworker/u8:0+flush-259:008:16:152
903161992318,4cyclictest859661-21kworker/u8:1+events_unbound07:29:152
903161992317,4cyclictest913449-21latency_hist07:20:002
903158992320,2cyclictest1043999-21kworker/u8:4+events_unbound09:30:181
903156992319,3cyclictest981183-21kworker/u8:1+flush-259:008:40:220
903156992319,3cyclictest965652-21kworker/u8:3+flush-259:008:10:210
903156992319,3cyclictest959831-21kworker/u8:2+events_unbound08:15:170
903156992318,3cyclictest954932-21apt-get08:00:120
903166992219,2cyclictest939204-21kworker/u8:3+events_unbound07:50:173
903166992218,3cyclictest1230801-21kworker/u8:2+flush-259:012:30:273
903161992219,2cyclictest1199968-21kworker/u8:4+events_unbound12:35:002
903158992219,2cyclictest1178871-21kworker/u8:1+events_unbound12:05:221
903158992218,3cyclictest959831-21kworker/u8:2+flush-259:008:45:001
903158992217,4cyclictest1236249-21apt-get12:30:151
903158992217,3cyclictest1142406-21kworker/u8:1+flush-259:011:10:211
903158992215,5cyclictest1230776-21latency_hist12:25:011
903158992215,5cyclictest1230776-21latency_hist12:25:011
903156992219,2cyclictest959831-21kworker/u8:2+events_unbound08:30:220
903156992218,3cyclictest981183-21kworker/u8:1+flush-259:009:15:210
903156992218,3cyclictest898199-21kworker/u8:0+events_unbound07:15:160
903156992217,4cyclictest1205178-21apt-get12:00:120
90315699221,19cyclictest509-21rs:main0
903166992118,2cyclictest898199-21kworker/u8:0+flush-259:008:20:213
903161992118,2cyclictest1079998-21kworker/u8:2+flush-259:010:05:002
903161992118,2cyclictest1043999-21kworker/u8:4+events_unbound09:55:122
903161992117,3cyclictest1105814-21kworker/u8:2+flush-259:010:30:152
903161992116,4cyclictest1194359-21kworker/u8:0+events_unbound11:55:472
903158992117,3cyclictest1121373-21kworker/u8:3+flush-259:010:45:011
903158992117,3cyclictest1121373-21kworker/u8:3+events_unbound11:05:271
903156992118,2cyclictest981183-21kworker/u8:1+flush-259:008:35:210
903156992118,2cyclictest981183-21kworker/u8:1+events_unbound08:50:190
903156992117,3cyclictest898199-21kworker/u8:0+events_unbound07:45:130
903156992117,3cyclictest1043999-21kworker/u8:4+events_unbound09:25:240
903156992117,2cyclictest0-21swapper/009:05:130
903166992017,2cyclictest859661-21kworker/u8:1+events_unbound07:45:023
903166992017,2cyclictest1199968-21kworker/u8:4+events_unbound12:35:233
903166992016,3cyclictest1043691-21kworker/u8:0+events_unbound09:45:273
903161992017,2cyclictest949755-21apt-get07:55:112
903158992016,3cyclictest898199-21kworker/u8:0+flush-259:009:00:211
903158992014,5cyclictest1194850-21apt-get11:50:131
903156992016,3cyclictest1178871-21kworker/u8:1+flush-259:012:35:180
903156992016,3cyclictest1178871-21kworker/u8:1+events_unbound12:05:160
903156992016,3cyclictest1115777-21kworker/u8:0+events_unbound10:35:170
903166991915,3cyclictest959831-21kworker/u8:2+events_unbound08:48:143
903161991915,3cyclictest928922-21kworker/u8:2+flush-259:007:36:432
903161991914,4cyclictest1199968-21kworker/u8:4+flush-259:012:25:102
903158991915,2cyclictest0-21swapper/110:10:001
903158991915,2cyclictest0-21swapper/110:10:001
903156991915,3cyclictest1607760-21fwupd11:37:100
903156991915,3cyclictest1121373-21kworker/u8:3+events_unbound11:15:100
903166991815,2cyclictest1199968-21kworker/u8:4+flush-259:012:00:463
903166991814,3cyclictest859661-21kworker/u8:1+events_unbound07:55:213
903166991812,4cyclictest1116409-21apt-get10:35:103
903161991814,3cyclictest898199-21kworker/u8:0+events_unbound07:40:162
90316199180,17cyclictest1-21systemd11:02:132
903158991814,3cyclictest1115777-21kworker/u8:0+events_unbound10:45:121
903158991814,3cyclictest1043999-21kworker/u8:4+events_unbound09:45:171
903156991812,5cyclictest1151399-21ntpq11:05:230
903166991714,2cyclictest1232065-21kthreadcore12:25:163
903166991713,3cyclictest1199968-21kworker/u8:4+events_unbound12:18:153
903166991713,3cyclictest1199968-21kworker/u8:4+events_unbound12:18:143
903161991714,2cyclictest1178871-21kworker/u8:1+flush-259:012:37:502
903161991714,2cyclictest1178871-21kworker/u8:1+events_unbound12:10:202
903161991714,2cyclictest0-21swapper/209:20:002
903161991713,3cyclictest1199968-21kworker/u8:4+flush-259:012:20:112
903161991713,3cyclictest1199968-21kworker/u8:4+flush-259:012:20:102
903158991712,3cyclictest1189019-21gpgv11:44:591
903156991714,2cyclictest60350irq/132-enp0s29f1:rx-008:46:040
903156991713,3cyclictest1100329-21kworker/u8:3+flush-259:010:25:210
903156991713,3cyclictest1037954-21kworker/u8:2+events_unbound09:24:150
903166991613,2cyclictest1178871-21kworker/u8:1+events_unbound12:05:153
903161991612,3cyclictest959831-21kworker/u8:2+events_unbound08:37:152
903161991612,3cyclictest1162032-21kworker/u8:0+events_unbound11:26:142
903161991612,3cyclictest1121373-21kworker/u8:3+events_unbound11:15:022
903156991614,1cyclictest60350irq/132-enp0s29f1:rx-011:30:230
903156991613,2cyclictest60350irq/132-enp0s29f1:rx-012:15:130
903156991613,2cyclictest60350irq/132-enp0s29f1:rx-012:15:130
903156991613,2cyclictest60350irq/132-enp0s29f1:rx-010:55:500
903156991613,2cyclictest60350irq/132-enp0s29f1:rx-010:42:230
903161991511,3cyclictest1121373-21kworker/u8:3+flush-259:011:34:432
903158991512,2cyclictest0-21swapper/111:00:011
903158991512,1cyclictest0-21swapper/111:59:591
903156991513,1cyclictest60350irq/132-enp0s29f1:rx-007:10:210
903156991512,2cyclictest60350irq/132-enp0s29f1:rx-010:30:150
903156991511,3cyclictest1230801-21kworker/u8:2+events_unbound12:30:290
903156991511,3cyclictest1043691-21kworker/u8:0+flush-259:010:00:180
903156991510,4cyclictest1059623-21apt-get09:40:110
90316699149,4cyclictest1037954-21kworker/u8:2+flush-259:009:30:303
903166991411,2cyclictest859661-21kworker/u8:1+flush-259:007:41:293
903158991411,2cyclictest859661-21kworker/u8:1+events_unbound07:30:191
903156991413,1cyclictest60350irq/132-enp0s29f1:rx-007:55:230
903156991412,1cyclictest60350irq/132-enp0s29f1:rx-010:15:170
903156991412,1cyclictest60350irq/132-enp0s29f1:rx-007:25:160
903156991411,2cyclictest60350irq/132-enp0s29f1:rx-011:50:200
903156991411,2cyclictest60350irq/132-enp0s29f1:rx-009:35:110
903156991411,2cyclictest60350irq/132-enp0s29f1:rx-007:20:120
903156991411,2cyclictest1101313-21irqcore10:20:160
903166991310,2cyclictest1115777-21kworker/u8:0+events_unbound10:55:273
90316199139,3cyclictest1043999-21kworker/u8:4+events_unbound09:49:132
90315899139,3cyclictest959831-21kworker/u8:2+events_unbound08:45:251
90315899139,3cyclictest939204-21kworker/u8:3+flush-259:008:01:431
903156991310,2cyclictest60350irq/132-enp0s29f1:rx-007:35:160
90316199128,3cyclictest1178871-21kworker/u8:1+flush-259:011:50:172
903158991210,1cyclictest1210107-21idleruntime-cro12:05:001
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional