You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-07-05 - 21:41

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack5slot4s.osadl.org (updated Fri Jul 04, 2025 12:44:38)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
745799182179,1cyclictest0-21swapper/107:14:181
745599161151,9cyclictest0-21swapper/007:10:000
2096211994,10sleep20-21swapper/207:05:112
746099115113,1cyclictest0-21swapper/207:10:002
21902115102,9sleep30-21swapper/307:05:173
6936210996,10sleep10-21swapper/107:06:061
7042210795,9sleep00-21swapper/007:07:290
7460995753,3cyclictest31576-21kworker/u16:1+events_unbound08:40:022
7460995247,3cyclictest20810-21kworker/u16:2+events_unbound10:45:022
7460994742,3cyclictest31576-21kworker/u16:1+events_unbound08:45:262
7457994539,5cyclictest20810-21kworker/u16:2+events_unbound12:15:021
7460994441,2cyclictest20810-21kworker/u16:2+events_unbound07:55:322
7460994340,2cyclictest20810-21kworker/u16:2+events_unbound12:35:272
7460994339,3cyclictest31576-21kworker/u16:1+events_unbound07:30:242
7460994238,3cyclictest31576-21kworker/u16:1+events_unbound08:00:162
7460994238,3cyclictest20810-21kworker/u16:2+events_unbound10:40:272
7460994238,3cyclictest20810-21kworker/u16:2+events_unbound08:50:272
7460994238,3cyclictest20810-21kworker/u16:2+events_unbound08:10:292
7460994236,2cyclictest20810-21kworker/u16:2+events_unbound07:25:172
223442420,1sleep0181rcuc/010:45:210
7460994036,3cyclictest20810-21kworker/u16:2+events_unbound09:20:272
7460993936,2cyclictest20810-21kworker/u16:2+events_unbound09:45:272
7460993834,3cyclictest20810-21kworker/u16:2+events_unbound08:05:262
7460993830,3cyclictest20810-21kworker/u16:2+events_unbound11:55:252
7460993734,2cyclictest20810-21kworker/u16:2+events_unbound10:00:252
7460993733,3cyclictest20810-21kworker/u16:2+events_unbound12:10:202
7460993733,3cyclictest20810-21kworker/u16:2+events_unbound09:35:252
7460993733,3cyclictest20810-21kworker/u16:2+events_unbound07:15:222
7460993632,3cyclictest31576-21kworker/u16:1+events_unbound11:05:272
7460993632,3cyclictest31576-21kworker/u16:1+events_unbound08:35:172
7460993632,3cyclictest31576-21kworker/u16:1+events_unbound08:20:262
7460993532,2cyclictest20810-21kworker/u16:2+events_unbound09:05:172
7460993531,3cyclictest31576-21kworker/u16:1+events_unbound12:30:282
7460993528,3cyclictest31576-21kworker/u16:1+events_unbound08:55:372
7460993431,2cyclictest20810-21kworker/u16:2+events_unbound09:40:162
7460993431,2cyclictest20810-21kworker/u16:2+events_unbound07:40:252
7460993430,3cyclictest31576-21kworker/u16:1+events_unbound11:00:152
7460993430,3cyclictest31576-21kworker/u16:1+events_unbound10:20:272
7460993430,3cyclictest31576-21kworker/u16:1+events_unbound07:20:302
7460993330,2cyclictest31576-21kworker/u16:1+events_unbound09:00:162
7460993329,3cyclictest31576-21kworker/u16:1+events_unbound12:25:272
7460993329,3cyclictest31576-21kworker/u16:1+events_unbound11:20:182
7460993329,3cyclictest20810-21kworker/u16:2+events_unbound10:15:212
7460993326,2cyclictest20810-21kworker/u16:2+events_unbound09:55:242
7460993325,3cyclictest20810-21kworker/u16:2+events_unbound11:50:162
7460993229,2cyclictest31576-21kworker/u16:1+events_unbound09:15:262
7460993229,2cyclictest20810-21kworker/u16:2+events_unbound10:50:242
7460993229,2cyclictest20810-21kworker/u16:2+events_unbound10:50:242
7460993228,3cyclictest31576-21kworker/u16:1+events_unbound07:35:272
7460993226,3cyclictest31576-21kworker/u16:1+events_unbound09:10:152
7460993129,2cyclictest20810-21kworker/u16:2+events_unbound08:30:172
7460993127,3cyclictest31576-21kworker/u16:1+events_unbound10:35:262
7460993027,2cyclictest31576-21kworker/u16:1+events_unbound09:30:272
7460993027,2cyclictest31576-21kworker/u16:1+events_unbound09:25:182
7460993027,2cyclictest20810-21kworker/u16:2+events_unbound11:45:272
7460993027,2cyclictest20810-21kworker/u16:2+events_unbound11:15:252
7460993026,3cyclictest31576-21kworker/u16:1+events_unbound11:40:282
7460993026,3cyclictest20810-21kworker/u16:2+events_unbound11:35:292
7460992927,1cyclictest20810-21kworker/u16:2+events_unbound11:30:262
7460992925,3cyclictest31576-21kworker/u16:1+events_unbound10:05:182
7460992925,3cyclictest31576-21kworker/u16:1+events_unbound08:25:162
7460992925,3cyclictest31576-21kworker/u16:1+events_unbound07:50:212
7460992925,3cyclictest20810-21kworker/u16:2+events_unbound07:45:262
7460992825,2cyclictest31576-21kworker/u16:1+events_unbound12:20:182
7457992815,12cyclictest8250-21cut09:05:191
7460992724,2cyclictest31576-21kworker/u16:1+events_unbound11:10:172
7457992723,3cyclictest31576-21kworker/u16:1+events_unbound11:40:131
7460992623,2cyclictest20810-21kworker/u16:2+events_unbound12:00:002
7460992622,3cyclictest31576-21kworker/u16:1+events_unbound11:25:172
7460992622,3cyclictest31576-21kworker/u16:1+events_unbound10:55:142
7460992619,3cyclictest20810-21kworker/u16:2+events_unbound12:15:152
7457992511,11cyclictest449-21sed08:30:001
7455992516,7cyclictest4608-21irqrtprio11:00:180
7460992421,2cyclictest20810-21kworker/u16:2+events_unbound08:15:142
7460992420,3cyclictest20810-21kworker/u16:2+events_unbound09:50:272
7460992320,2cyclictest20810-21kworker/u16:2+events_unbound10:30:172
745799232,14cyclictest14356-21kthreadcore09:10:181
745799214,16cyclictest0-21swapper/108:50:191
745799213,15cyclictest6475-21taskset09:01:541
7457992111,8cyclictest271ktimers/107:57:161
7460992016,3cyclictest20810-21kworker/u16:2+events_unbound10:25:302
745799204,11cyclictest722-21snmpd09:57:461
745799203,16cyclictest0-21swapper/111:00:391
7460991916,2cyclictest20810-21kworker/u16:2+events_unbound10:10:162
745799194,15cyclictest0-21swapper/108:05:241
745799194,14cyclictest0-21swapper/111:45:231
745799194,14cyclictest0-21swapper/111:05:191
745799194,12cyclictest7448-21cyclictest11:25:021
745799194,12cyclictest0-21swapper/108:20:151
745799194,12cyclictest0-21swapper/107:45:071
745799194,11cyclictest161632chrt08:12:241
745799193,13cyclictest1424-21cat10:25:231
745799192,14cyclictest18890-21apt-get10:45:031
745799192,14cyclictest0-21swapper/112:25:071
745799192,14cyclictest0-21swapper/109:50:061
745799192,14cyclictest0-21swapper/109:40:021
745799192,14cyclictest0-21swapper/107:35:121
745799192,12cyclictest22682-21grep07:20:231
745799192,12cyclictest17219-21munin-run08:45:011
745799191,15cyclictest0-21swapper/108:55:121
745599190,1cyclictest0-21swapper/007:40:140
745599190,18cyclictest0-21swapper/011:15:130
745599190,18cyclictest0-21swapper/010:20:250
745799185,10cyclictest0-21swapper/107:53:151
745799184,14cyclictest0-21swapper/110:43:111
745799184,14cyclictest0-21swapper/109:46:221
745799184,14cyclictest0-21swapper/109:18:271
745799184,11cyclictest0-21swapper/110:54:551
745799184,11cyclictest0-21swapper/110:54:541
745799184,11cyclictest0-21swapper/109:27:151
745799183,8cyclictest147192sleep112:05:301
745799183,14cyclictest0-21swapper/112:12:141
745799183,14cyclictest0-21swapper/111:59:551
745799183,14cyclictest0-21swapper/110:31:391
745799183,14cyclictest0-21swapper/107:43:121
745799183,14cyclictest0-21swapper/107:15:591
745799183,12cyclictest0-21swapper/109:35:031
745799182,8cyclictest14931-21df_inode11:10:151
745799181,9cyclictest6249-21taskset12:30:191
745599183,10cyclictest29026-21awk09:54:590
7455991810,7cyclictest28612-21cron09:25:010
745599180,9cyclictest1661-21munin-run09:30:000
745799174,12cyclictest0-21swapper/110:01:151
745799173,14cyclictest0-21swapper/112:00:231
745799173,14cyclictest0-21swapper/110:55:541
745799173,14cyclictest0-21swapper/110:07:191
745799173,14cyclictest0-21swapper/109:22:111
745799173,14cyclictest0-21swapper/108:15:281
745799172,14cyclictest0-21swapper/111:39:191
745799172,14cyclictest0-21swapper/108:36:121
745799172,12cyclictest0-21swapper/112:20:071
745799172,12cyclictest0-21swapper/110:21:021
745799172,12cyclictest0-21swapper/110:15:541
745799172,11cyclictest722-21snmpd07:25:481
745799172,11cyclictest0-21swapper/108:47:151
745599171,9cyclictest26943-21munin-run07:54:590
7455991713,3cyclictest29507-21irqrtprio08:55:410
745599171,11cyclictest0-21swapper/009:10:070
745599170,9cyclictest19263-21fschecks_time10:15:170
745599170,9cyclictest10725-21aten2_r5power_c12:35:150
745599170,1cyclictest0-21swapper/009:45:140
7460991614,2cyclictest31576-21kworker/u16:1+events_unbound12:05:182
745799167,8cyclictest0-21swapper/111:52:051
745799163,8cyclictest14841-21memory12:35:231
745799163,4cyclictest0-21swapper/107:32:321
745799162,14cyclictest0-21swapper/111:32:461
745799162,14cyclictest0-21swapper/110:10:311
745799162,14cyclictest0-21swapper/109:34:311
745799162,11cyclictest29782-21ntpq11:20:271
745799162,11cyclictest0-21swapper/108:03:361
745799162,10cyclictest0-21swapper/108:30:231
745799161,12cyclictest0-21swapper/111:15:071
745599168,7cyclictest433-21ls12:25:180
745599163,6cyclictest0-21swapper/008:15:200
745599160,1cyclictest0-21swapper/012:06:400
745599160,15cyclictest6025-21cstates08:05:210
745599160,13cyclictest0-21swapper/008:50:140
745599160,11cyclictest0-21swapper/008:00:200
745599160,10cyclictest30916-21grep08:25:240
745599160,10cyclictest11810-21kthreadcore10:35:210
745799151,9cyclictest8889-21smartctl10:35:171
745599158,6cyclictest4122-21cron12:00:000
745599158,6cyclictest10115-21run-parts07:37:450
745599153,6cyclictest30252-21debian-sa110:55:000
745599153,6cyclictest30252-21debian-sa110:55:000
745599151,9cyclictest18902-21turbostat10:45:000
745599151,12cyclictest9456-21apt-get11:35:150
745599150,8cyclictest30111-21/usr/sbin/munin10:25:170
745599150,8cyclictest25566-21aten2_r5power_p11:20:160
745599150,8cyclictest0-21swapper/010:35:000
745599150,7cyclictest13613-21basename09:40:170
745599150,4cyclictest26120-21taskset12:16:160
745599150,1cyclictest0-21swapper/011:05:270
745599150,13cyclictest28379-21kthreadcore11:50:210
745599150,13cyclictest20540-21latency_hist12:14:590
745599150,13cyclictest17989-21unixbench-2d10:10:280
745599150,13cyclictest11802-21sendmail_mailqu09:35:250
745599150,10cyclictest6918-21cat10:00:260
745599147,6cyclictest15207-21tr11:40:150
745599147,5cyclictest320432sleep007:30:110
745599143,10cyclictest0-21swapper/009:55:140
745599141,8cyclictest19833-21cat09:15:190
745599141,11cyclictest21127-21apt-get07:20:120
745599141,10cyclictest0-21swapper/012:30:130
745599140,9cyclictest8060-21grep08:35:190
745599140,9cyclictest31186-21expr11:25:150
745599140,8cyclictest19486-21kthreadcore08:45:200
745599140,8cyclictest17503-21kthreadcore07:45:200
745599140,8cyclictest1678-21awk09:00:150
745599140,4cyclictest8433-21head10:05:200
745599140,4cyclictest16346-21proc_pri08:40:400
745599140,4cyclictest14859-21expr11:10:150
745599140,13cyclictest8691-21cat09:05:190
745599140,13cyclictest6911-21kthreadcore12:00:220
745599140,13cyclictest6585-21timerwakeupswit09:30:270
745599140,12cyclictest8062-21latency11:30:220
745599140,12cyclictest32548-21sed08:00:000
745599140,12cyclictest26685-21runrttasks12:20:080
745599140,12cyclictest25493-21kthreadcore08:20:220
745599140,12cyclictest20983-21latency_hist07:19:590
745599140,11cyclictest722-21snmpd08:10:150
305072140,0sleep00-21swapper/007:25:200
745599131,11cyclictest30921-21df_inode10:55:150
745599130,7cyclictest2022-21kthreadcore08:30:190
745599130,4cyclictest20422-21/usr/sbin/munin11:45:190
146072100,2sleep30-21swapper/310:40:203
none10:52:287
none10:52:287
none10:52:287
none10:52:287
none10:52:287
none10:52:287
none10:52:287
none10:52:287
none10:52:287
none10:52:287
none10:52:287
none10:52:287
none10:52:287
none10:52:287
none10:52:287
none10:52:287
none10:52:287
none10:52:287
none10:52:287
none10:52:287
none10:52:287
none10:52:287
none10:52:287
none10:52:287
none10:52:287
none10:52:287
none10:52:287
none10:52:287
none10:52:287
none10:52:287
none10:52:287
none10:52:287
none10:52:287
none10:52:287
none10:52:287
none10:52:287
none10:52:287
none10:52:287
none10:52:287
none10:52:287
none10:52:287
none10:52:287
none10:52:287
none10:52:287
none10:52:287
none10:52:287
none10:52:287
none10:52:287
none10:52:287
none10:52:287
none10:52:287
none10:52:287
none10:52:287
none10:52:287
none10:52:287
none10:52:287
none10:52:287
none10:52:287
none10:52:287
none10:52:287
none10:52:287
none10:52:287
none10:52:287
none10:52:287
none10:52:287
none10:52:287
none10:52:287
none10:52:287
6713270,1sleep30-21swapper/309:05:013
31711270,6sleep30-21swapper/312:22:253
16256270,5sleep30-21swapper/307:45:123
13135270,6sleep30-21swapper/310:36:403
none10:52:286
none10:52:286
none10:52:286
none10:52:286
none10:52:286
none10:52:286
none10:52:286
none10:52:286
none10:52:286
none10:52:286
none10:52:286
none10:52:286
none10:52:286
none10:52:286
none10:52:286
none10:52:286
none10:52:286
none10:52:286
none10:52:286
none10:52:286
none10:52:286
none10:52:286
none10:52:286
none10:52:286
none10:52:286
none10:52:286
none10:52:286
none10:52:286
none10:52:286
none10:52:286
none10:52:286
none10:52:286
none10:52:286
none10:52:286
none10:52:286
none10:52:286
none10:52:286
none10:52:286
none10:52:286
none10:52:286
none10:52:286
none10:52:286
none10:52:286
none10:52:286
none10:52:286
none10:52:286
none10:52:286
none10:52:286
none10:52:286
none10:52:286
none10:52:286
none10:52:286
none10:52:286
none10:52:286
none10:52:286
none10:52:286
none10:52:286
none10:52:286
none10:52:286
none10:52:286
none10:52:286
none10:52:286
none10:52:286
none10:52:286
none10:52:286
none10:52:286
none10:52:286
none10:52:286
9429260,2sleep30-21swapper/312:02:443
7932260,4sleep30-21swapper/307:10:023
32174260,4sleep30-21swapper/312:25:133
30941260,4sleep30-21swapper/311:25:133
30114260,2sleep30-21swapper/310:53:273
30114260,2sleep30-21swapper/310:53:263
26908263,2sleep30-21swapper/307:54:513
24730263,2sleep30-21swapper/310:49:413
24259260,4sleep30-21swapper/311:15:223
21123260,4sleep30-21swapper/307:20:123
20421260,4sleep30-21swapper/311:45:133
16083260,2sleep30-21swapper/308:11:213
13335260,1sleep30-21swapper/311:05:253
12878260,4sleep30-21swapper/309:40:123
12340260,2sleep30-21swapper/309:36:383
11980260,4sleep30-21swapper/308:40:123
none10:52:285
none10:52:285
none10:52:285
none10:52:285
none10:52:285
none10:52:285
none10:52:285
none10:52:285
none10:52:285
none10:52:285
none10:52:285
none10:52:285
none10:52:285
none10:52:285
none10:52:285
none10:52:285
none10:52:285
none10:52:285
none10:52:285
none10:52:285
none10:52:285
none10:52:285
none10:52:285
none10:52:285
none10:52:285
none10:52:285
none10:52:285
none10:52:285
none10:52:285
none10:52:285
none10:52:285
none10:52:285
none10:52:285
none10:52:285
none10:52:285
none10:52:285
none10:52:285
none10:52:285
none10:52:285
none10:52:285
none10:52:285
none10:52:285
none10:52:285
none10:52:285
none10:52:285
none10:52:285
none10:52:285
none10:52:285
none10:52:285
none10:52:285
none10:52:285
none10:52:285
none10:52:285
none10:52:285
none10:52:285
none10:52:285
none10:52:285
none10:52:285
none10:52:285
none10:52:285
none10:52:285
none10:52:285
none10:52:285
none10:52:285
none10:52:285
none10:52:285
none10:52:285
none10:52:285
6788250,2sleep30-21swapper/309:30:533
5669250,4sleep30-21swapper/308:33:113
5033251,2sleep30-21swapper/311:00:203
3940250,4sleep30-21swapper/311:57:433
28800250,2sleep30-21swapper/309:52:233
28181250,2sleep30-21swapper/308:54:503
27220250,2sleep30-21swapper/308:23:443
26408250,2sleep30-21swapper/312:20:003
22830250,4sleep30-21swapper/309:16:113
22759250,3sleep30-21swapper/310:15:233
20508250,4sleep30-21swapper/307:15:433
20215252,2sleep30-21swapper/312:10:543
19865250,2sleep30-21swapper/311:41:123
18180250,1sleep30-21swapper/310:11:253
17466250,3sleep30-21swapper/308:45:133
15823250,2sleep30-21swapper/307:42:483
14651250,2sleep30-21swapper/311:39:443
14492250,2sleep30-21swapper/311:10:023
none10:52:284
none10:52:284
none10:52:284
none10:52:284
none10:52:284
none10:52:284
none10:52:284
none10:52:284
none10:52:284
none10:52:284
none10:52:284
none10:52:284
none10:52:284
none10:52:284
none10:52:284
none10:52:284
none10:52:284
none10:52:284
none10:52:284
none10:52:284
none10:52:284
none10:52:284
none10:52:284
none10:52:284
none10:52:284
none10:52:284
none10:52:284
none10:52:284
none10:52:284
none10:52:284
none10:52:284
none10:52:284
none10:52:284
none10:52:284
none10:52:284
none10:52:284
none10:52:284
none10:52:284
none10:52:284
none10:52:284
none10:52:284
none10:52:284
none10:52:284
none10:52:284
none10:52:284
none10:52:284
none10:52:284
none10:52:284
none10:52:284
none10:52:284
none10:52:284
none10:52:284
none10:52:284
none10:52:284
none10:52:284
none10:52:284
none10:52:284
none10:52:284
none10:52:284
none10:52:284
none10:52:284
none10:52:284
none10:52:284
none10:52:284
none10:52:284
none10:52:284
none10:52:284
none10:52:284
6876240,2sleep30-21swapper/308:35:193
5440240,2sleep30-21swapper/308:05:013
4563240,3sleep30-21swapper/307:31:423
31072240,2sleep30-21swapper/311:54:553
30613240,3sleep30-21swapper/311:24:083
30279240,2sleep30-21swapper/308:55:423
29402240,2sleep30-21swapper/310:25:013
29005240,2sleep30-21swapper/307:55:273
2751240,2sleep30-21swapper/310:00:163
27320240,2sleep30-21swapper/308:25:013
26337240,2sleep30-21swapper/307:25:013
21832240,2sleep30-21swapper/308:19:553
2124240,3sleep30-21swapper/310:55:233
19360240,2sleep30-21swapper/309:45:213
15926240,2sleep30-21swapper/312:39:593
15021241,2sleep30-21swapper/312:09:263
10483240,2sleep30-21swapper/307:39:553
10435240,2sleep30-21swapper/312:34:553
7561230,2sleep30-21swapper/310:05:003
3972230,2sleep30-21swapper/311:30:103
32652230,2sleep30-21swapper/308:00:043
29253230,2sleep30-21swapper/309:55:033
28865230,2sleep30-21swapper/309:25:093
2683230,2sleep30-21swapper/310:30:023
24190230,2sleep30-21swapper/310:20:043
23403230,2sleep30-21swapper/309:20:083
1511230,2sleep30-21swapper/309:00:113
12452230,2sleep30-21swapper/309:10:103
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional