You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-11 - 20:53

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Phytec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackbslot5s.osadl.org (updated Sat Apr 11, 2026 12:44:47)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2334148995641,12cyclictest121ktimers/007:15:130
2334162995521,10cyclictest2361514-21wc08:25:233
2334159995142,6cyclictest2429340-21munin-plugin-st11:45:002
2334148995136,11cyclictest121ktimers/011:25:120
2334162994840,4cyclictest2410574-21munin-plugin-st10:50:003
2334162994334,6cyclictest2351469-21unixbench_multi07:55:263
2334153994228,5cyclictest131rcu_preempt10:20:001
2334153994228,5cyclictest131rcu_preempt10:20:001
2334153994129,7cyclictest0-21swapper/109:40:001
2334162994031,6cyclictest2372390-21cron09:00:013
2334153994032,4cyclictest2431028-21auditctl11:50:001
2334153994031,6cyclictest2396288-21grep10:05:251
2334159993929,8cyclictest2380599-21kworker/u8:2+events_unbound09:45:142
2334153993928,7cyclictest2429326-21cron11:45:001
2334148993929,6cyclictest0-21swapper/008:25:000
2334159993831,5cyclictest2313015-21kworker/u8:2+events_unbound08:40:342
2334159993831,4cyclictest2375822-21latency_hist09:10:002
2334159993830,6cyclictest2313015-21kworker/u8:2+events_unbound07:45:192
2334159993826,8cyclictest2440782-21tail12:15:262
2334162993730,4cyclictest2363866-21cron08:35:003
2334162993729,5cyclictest2373707-21unixbench_singl09:00:253
2334162993728,5cyclictest2442957-21cron12:25:003
2334162993727,6cyclictest0-21swapper/310:15:173
2334162993727,6cyclictest0-21swapper/310:15:163
2334159993731,4cyclictest2436703-21kworker/u8:2+events_unbound12:11:092
2334153993725,8cyclictest2365160-21grep08:35:271
2334148993727,6cyclictest2432257-21grep11:50:270
2334162993628,4cyclictest0-21swapper/308:50:263
2334162993628,4cyclictest0-21swapper/308:50:263
2334159993630,4cyclictest2405324-21kworker/u8:1+events_unbound10:40:542
2334159993629,4cyclictest0-21swapper/211:50:272
2334159993619,12cyclictest204-21dbus-daemon07:25:072
2334153993627,5cyclictest0-21swapper/111:00:001
2334153993627,5cyclictest0-21swapper/109:20:171
2334162993526,5cyclictest2360489-21idleruntime-cro08:25:003
2334162993523,9cyclictest2338222-21latency_hist07:20:023
2334159993526,5cyclictest0-21swapper/208:05:262
2334159993525,7cyclictest0-21swapper/209:40:012
2334153993526,5cyclictest2405445-21cron10:35:001
2334153993524,7cyclictest2447857-21grep12:35:261
233414899353,6cyclictest131rcu_preempt09:15:140
2334148993529,3cyclictest0-21swapper/008:40:000
2334162993426,4cyclictest2439541-21cron12:15:003
2334159993426,4cyclictest0-21swapper/212:00:152
2334159993425,7cyclictest2426276-21fschecks_count11:35:152
2334159993423,7cyclictest0-21swapper/208:10:262
2334153993425,6cyclictest0-21swapper/108:00:021
2334153993421,8cyclictest0-21swapper/111:35:241
2334148993418,13cyclictest11-21ksoftirqd/010:25:140
2334162993323,6cyclictest0-21swapper/309:40:003
2334159993325,4cyclictest0-21swapper/210:00:002
2334159993324,5cyclictest0-21swapper/212:25:002
2334159993319,6cyclictest2387817-21kworker/u8:3+events_unbound10:01:002
2334153993325,4cyclictest0-21swapper/108:25:151
2334153993322,7cyclictest2422105-21grep11:20:261
2334153993322,7cyclictest2394603-21grep10:00:251
2334148993318,12cyclictest11-21ksoftirqd/011:00:150
2334162993225,4cyclictest2420797-21munin-plugin-st11:20:003
2334162993225,4cyclictest2420797-21munin-plugin-st11:20:003
2334162993222,7cyclictest2403527-21sh10:30:003
2334159993221,8cyclictest2343020-21grep07:30:252
2334159993221,8cyclictest2343020-21grep07:30:252
2334153993224,4cyclictest2442960-21cron12:25:001
2334153993224,4cyclictest2341717-21auditctl07:30:001
2334153993224,4cyclictest0-21swapper/108:35:001
2334148993223,6cyclictest2447850-21unixbench_singl12:35:270
2334162993124,4cyclictest0-21swapper/307:20:253
2334159993122,7cyclictest2436703-21kworker/u8:2+events_unbound12:33:212
2334159993121,6cyclictest2335318-21grep07:10:252
2334153993122,5cyclictest2357856-21sshd08:15:221
2334153993120,5cyclictest0-21swapper/108:45:251
2334153993118,8cyclictest0-21swapper/111:30:001
2334148993121,6cyclictest0-21swapper/010:05:240
2334148993121,6cyclictest0-21swapper/007:15:010
2334162993022,4cyclictest0-21swapper/311:25:153
2334162993022,4cyclictest0-21swapper/310:30:253
2334162993018,7cyclictest2413483-21grep10:55:253
2334159993020,6cyclictest0-21swapper/208:15:272
2334159993018,9cyclictest2391588-21auditctl09:55:002
2334153993022,4cyclictest0-21swapper/112:15:251
2334153993022,4cyclictest0-21swapper/111:05:261
2334153993021,6cyclictest2420796-21munin-plugin-st11:20:001
2334153993021,6cyclictest2420796-21munin-plugin-st11:20:001
2334153993017,9cyclictest0-21swapper/107:45:121
2334148993023,3cyclictest0-21swapper/012:00:250
2334148993018,7cyclictest2391185-21grep09:50:260
2334162992923,4cyclictest391ktimers/310:10:123
2334162992921,6cyclictest2345740-21kernelversion07:40:193
2334162992921,5cyclictest2444664-21sh12:30:003
2334162992921,5cyclictest2379238-21sh09:20:013
2334162992920,6cyclictest0-21swapper/312:35:003
2334159992923,4cyclictest2313015-21kworker/u8:2+events_unbound07:20:062
2334159992922,4cyclictest0-21swapper/210:55:152
2334159992921,4cyclictest0-21swapper/211:45:262
2334159992911,12cyclictest32-21ksoftirqd/209:15:142
2334153992921,5cyclictest2417969-21uname11:10:171
2334153992917,7cyclictest204-21dbus-daemon09:45:451
2334162992821,4cyclictest0-21swapper/310:40:163
2334162992821,4cyclictest0-21swapper/309:10:153
2334162992820,4cyclictest0-21swapper/308:10:173
2334162992819,5cyclictest2366812-21unixbench_multi08:40:253
2334162992817,7cyclictest0-21swapper/307:30:253
2334162992817,7cyclictest0-21swapper/307:30:253
2334159992822,4cyclictest2359009-21kworker/u8:3+events_unbound08:30:292
2334159992821,4cyclictest2345119-21kthreadd07:40:002
2334159992819,5cyclictest0-21swapper/207:45:002
2334159992818,6cyclictest438-21cron09:15:012
233415999281,7cyclictest0-21swapper/208:25:102
2334153992821,5cyclictest2394632-21kworker/u8:0+events_unbound10:40:461
2334153992821,3cyclictest0-21swapper/110:25:181
2334153992817,7cyclictest0-21swapper/109:50:261
2334148992822,4cyclictest2384152-21head09:30:240
2334148992822,4cyclictest145-21jbd2/mmcblk1p2-809:45:230
2334148992821,3cyclictest0-21swapper/009:40:170
2334148992821,3cyclictest0-21swapper/009:10:250
2334148992821,3cyclictest0-21swapper/007:25:010
2334148992818,6cyclictest2394548-21grep10:00:250
2334148992817,8cyclictest2393306-21sendmail10:00:000
2334162992721,3cyclictest0-21swapper/308:15:253
2334162992719,5cyclictest0-21swapper/311:05:263
233415999278,5cyclictest131rcu_preempt07:50:142
233415999273,4cyclictest131rcu_preempt11:20:142
2334159992721,3cyclictest0-21swapper/210:45:232
2334159992718,6cyclictest0-21swapper/208:40:002
2334159992718,6cyclictest0-21swapper/208:20:182
233415999271,4cyclictest131rcu_preempt10:50:132
2334153992719,4cyclictest0-21swapper/111:51:071
2334153992719,3cyclictest0-21swapper/108:50:261
2334153992719,3cyclictest0-21swapper/108:50:251
2334153992718,6cyclictest2382196-21grep09:25:251
2334153992717,6cyclictest0-21swapper/112:10:001
2334153992717,6cyclictest0-21swapper/108:05:261
2334148992723,2cyclictest13550irq/42-30be0000.ethernet12:25:170
2334148992719,4cyclictest0-21swapper/009:25:010
2334148992717,6cyclictest0-21swapper/012:20:260
2334148992717,6cyclictest0-21swapper/010:40:250
2334162992620,3cyclictest0-21swapper/310:35:163
2334162992618,4cyclictest0-21swapper/307:35:263
2334162992616,7cyclictest2383427-21kernelversion09:30:173
2334159992619,5cyclictest2420470-21kworker/u8:1+events_unbound11:25:262
2334159992619,5cyclictest2387817-21kworker/u8:3+events_unbound10:05:122
2334159992619,4cyclictest2410320-21kworker/u8:0+events_unbound12:10:012
2334159992619,4cyclictest0-21swapper/210:30:252
2334159992619,4cyclictest0-21swapper/209:40:272
2334159992619,4cyclictest0-21swapper/209:25:242
2334159992618,5cyclictest2417303-21kworker/u8:3+events_unbound11:30:212
2334159992618,4cyclictest0-21swapper/209:00:252
2334159992617,6cyclictest0-21swapper/210:15:002
2334159992612,3cyclictest131rcu_preempt08:54:282
2334159992612,3cyclictest131rcu_preempt08:54:282
2334159992611,6cyclictest2410320-21kworker/u8:0+events_unbound12:35:582
2334159992611,5cyclictest2410320-21kworker/u8:0+events_unbound12:25:162
2334153992615,7cyclictest2392854-21grep09:55:261
2334148992619,5cyclictest2387817-21kworker/u8:3+events_unbound10:20:490
2334148992619,4cyclictest13550irq/42-30be0000.ethernet10:55:250
2334148992619,3cyclictest0-21swapper/008:25:240
2334148992617,4cyclictest0-21swapper/012:10:160
2334148992614,8cyclictest164-21systemd-journal08:45:350
2334162992518,4cyclictest2354892-21tail08:05:263
2334162992518,4cyclictest0-21swapper/308:35:173
2334162992518,3cyclictest0-21swapper/309:50:273
2334162992517,5cyclictest53-21kcompactd007:10:163
2334162992517,5cyclictest391ktimers/307:29:213
2334162992517,4cyclictest0-21swapper/312:20:003
2334159992519,3cyclictest0-21swapper/209:20:152
2334159992516,6cyclictest0-21swapper/208:50:002
2334159992515,6cyclictest2419114-21sort11:15:002
2334159992513,5cyclictest131rcu_preempt08:59:062
2334159992512,6cyclictest2330326-21kworker/u8:1+events_unbound07:15:072
233415999251,12cyclictest0-21swapper/210:28:102
233415999251,12cyclictest0-21swapper/210:18:082
233415999251,12cyclictest0-21swapper/210:18:082
2334153992519,4cyclictest2372189-21kworker/u8:1+events_unbound09:00:381
2334153992518,4cyclictest2407150-21cron10:40:001
2334153992518,3cyclictest0-21swapper/112:10:221
2334153992517,5cyclictest231ktimers/108:56:491
2334153992517,4cyclictest0-21swapper/112:00:001
2334153992516,4cyclictest0-21swapper/109:15:021
2334148992518,3cyclictest0-21swapper/010:50:250
2334148992517,5cyclictest2341349-21kworker/u8:3+events_unbound07:38:020
2334148992517,5cyclictest0-21swapper/007:40:150
2334148992516,7cyclictest438-21cron12:20:000
2334148992516,5cyclictest0-21swapper/010:20:010
2334148992516,5cyclictest0-21swapper/010:20:000
2334148992516,5cyclictest0-21swapper/008:00:010
2334148992515,5cyclictest0-21swapper/012:30:250
233414899251,20cyclictest0-21swapper/008:02:430
2334162992417,3cyclictest0-21swapper/309:55:233
2334162992415,6cyclictest0-21swapper/308:05:013
2334159992417,3cyclictest0-21swapper/207:55:222
2334159992415,6cyclictest53-21kcompactd011:00:172
233415999241,12cyclictest2410320-21kworker/u8:0+events_unbound11:05:042
2334153992418,3cyclictest0-21swapper/109:30:221
2334153992418,3cyclictest0-21swapper/108:10:211
2334153992416,4cyclictest0-21swapper/110:45:161
233415399241,21cyclictest231ktimers/109:15:141
2334148992418,3cyclictest0-21swapper/009:30:010
2334148992418,3cyclictest0-21swapper/008:55:240
2334148992417,4cyclictest121ktimers/011:21:520
2334148992417,4cyclictest0-21swapper/008:50:260
2334148992417,4cyclictest0-21swapper/008:50:260
2334148992416,4cyclictest2434425-21sh12:00:000
2334148992414,6cyclictest0-21swapper/010:35:270
233414899241,19cyclictest0-21swapper/011:13:020
233414899241,19cyclictest0-21swapper/009:08:180
233414899241,19cyclictest0-21swapper/008:16:200
233414899241,19cyclictest0-21swapper/007:50:450
233414899241,19cyclictest0-21swapper/007:49:490
2334162992317,4cyclictest2387817-21kworker/u8:3+events_unbound09:46:433
2334162992317,4cyclictest178-21systemd-udevd11:14:403
2334162992317,3cyclictest2387247-21ntpq09:40:223
2334162992317,3cyclictest0-21swapper/311:00:203
2334162992316,3cyclictest0-21swapper/308:45:213
2334162992315,4cyclictest0-21swapper/311:20:263
2334162992314,4cyclictest0-21swapper/307:50:183
2334162992313,7cyclictest2437178-21sed12:05:263
2334162992312,8cyclictest2348737-21sed07:50:013
233415999233,4cyclictest131rcu_preempt10:35:172
2334159992317,4cyclictest2387817-21kworker/u8:3+events_unbound10:20:142
2334159992316,5cyclictest2351642-21kworker/u8:0+events_unbound08:04:502
2334159992316,4cyclictest0-21swapper/211:55:182
2334159992313,7cyclictest2384555-21debian-sa109:35:012
233415999231,12cyclictest0-21swapper/211:18:392
233415999231,12cyclictest0-21swapper/211:18:382
2334153992317,3cyclictest0-21swapper/112:30:191
2334153992317,3cyclictest0-21swapper/111:30:241
2334153992316,4cyclictest2343013-21unixbench_singl07:30:251
2334153992316,4cyclictest2343013-21unixbench_singl07:30:251
2334153992316,3cyclictest0-21swapper/107:20:251
2334153992315,5cyclictest0-21swapper/107:10:251
2334153992315,4cyclictest0-21swapper/110:10:161
2334153992314,6cyclictest231ktimers/109:40:231
2334153992310,9cyclictest204-21dbus-daemon08:20:261
233414899238,3cyclictest121ktimers/011:05:210
2334148992317,4cyclictest24198822sleep011:15:220
2334148992317,4cyclictest24198822sleep011:15:220
2334148992317,3cyclictest2436920-21ntpq12:05:210
2334148992316,5cyclictest2424142-21kworker/u8:2+events_unbound11:33:200
2334148992316,3cyclictest0-21swapper/010:14:170
2334148992316,3cyclictest0-21swapper/009:02:030
2334148992316,3cyclictest0-21swapper/008:33:000
2334148992316,3cyclictest0-21swapper/007:30:250
2334148992316,3cyclictest0-21swapper/007:30:250
233414899231,5cyclictest131rcu_preempt11:45:110
233414899231,18cyclictest0-21swapper/011:39:560
233414899231,18cyclictest0-21swapper/008:42:050
233414899230,19cyclictest0-21swapper/010:47:060
2334162992215,4cyclictest2382638-21cron09:30:023
2334162992215,4cyclictest0-21swapper/312:00:243
2334162992214,6cyclictest2411009-21fschecks_time10:50:163
2334162992214,4cyclictest0-21swapper/311:45:163
2334162992211,7cyclictest2434441-21ls12:00:003
233415399222,16cyclictest2336626-21runrttasks07:15:121
2334153992216,3cyclictest0-21swapper/112:00:241
2334148992216,3cyclictest0-21swapper/008:10:250
2334148992215,4cyclictest0-21swapper/011:40:150
233414899220,20cyclictest0-21swapper/010:33:000
233414899220,20cyclictest0-21swapper/007:25:220
233414899220,18cyclictest0-21swapper/008:07:070
2334162992115,3cyclictest0-21swapper/311:40:243
2334162992114,5cyclictest391ktimers/309:05:163
2334162992114,4cyclictest391ktimers/312:40:023
2334162992114,3cyclictest0-21swapper/309:20:253
2334153992115,3cyclictest0-21swapper/107:35:211
2334153992113,5cyclictest2313015-21kworker/u8:2+events_unbound08:00:421
2334153992113,5cyclictest0-21swapper/107:40:161
2334162992012,4cyclictest438-21cron10:25:003
2334162992012,4cyclictest0-21swapper/310:00:163
233416299200,18cyclictest391ktimers/310:05:113
233415399201,6cyclictest2313015-21kworker/u8:2+events_unbound07:50:181
2334162991911,5cyclictest0-21swapper/311:50:153
2334153991913,4cyclictest2443386-21fschecks_time12:25:161
2334153991913,3cyclictest0-21swapper/110:20:161
2334153991811,3cyclictest0-21swapper/111:00:191
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional