You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-14 - 03:36

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Phytec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackbslot5s.osadl.org (updated Tue Apr 14, 2026 00:44:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
593340994936,8cyclictest671179-21grep22:50:252
593333994933,13cyclictest634778-21kworker/u8:2+events_unbound22:25:120
593333994839,6cyclictest612837-21cron20:05:000
593344994725,6cyclictest131rcu_preempt23:15:123
593337994736,7cyclictest636724-21munin-plugin-st21:15:011
593344994536,5cyclictest619676-21munin-plugin-st20:25:003
593337994537,5cyclictest623058-21cron20:35:011
593344994438,4cyclictest666036-21kworker/u8:0+events_unbound23:07:463
593340994432,9cyclictest311ktimers/222:45:122
593333994438,3cyclictest638451-21modprobe21:20:010
593333994435,5cyclictest621370-21ls20:30:000
593340994234,5cyclictest683612-21ls23:30:002
593340994233,7cyclictest311ktimers/223:35:132
593340994233,5cyclictest662938-21latency_hist22:30:012
593344994134,4cyclictest687012-21cron23:40:003
593340994131,5cyclictest0-21swapper/200:00:002
593337994133,5cyclictest638430-21idleruntime-cro21:20:001
593333994132,6cyclictest693825-21cron00:00:000
593344994034,4cyclictest695218-21kworker/u8:1+events_unbound00:11:403
593344994034,4cyclictest639957-21kworker/u8:0+events_unbound21:26:423
593344994034,4cyclictest639957-21kworker/u8:0+events_unbound21:26:423
593344994032,5cyclictest638429-21awk21:19:593
593344994031,6cyclictest605621-21unixbench_singl19:40:263
59334499401,15cyclictest0-21swapper/323:50:133
593340994032,4cyclictest668278-21idleruntime-cro22:45:012
593340994028,7cyclictest0-21swapper/200:05:252
593337994030,6cyclictest0-21swapper/121:45:251
593344993932,4cyclictest665274-21latency22:35:213
593340993911,9cyclictest704762-21wc00:30:202
593337993930,5cyclictest687399-21fschecks_count23:40:161
59334499381,13cyclictest0-21swapper/323:30:123
593340993830,4cyclictest0-21swapper/222:40:012
593340993830,3cyclictest0-21swapper/222:55:152
593340993828,5cyclictest0-21swapper/200:05:002
593340993826,7cyclictest0-21swapper/222:10:252
593337993827,7cyclictest0-21swapper/123:00:011
593337993825,8cyclictest0-21swapper/120:50:261
593333993831,4cyclictest647586-21latency_hist21:45:010
593344993727,5cyclictest0-21swapper/322:47:373
593344993726,7cyclictest0-21swapper/320:40:253
593344993718,6cyclictest611040-21kworker/u8:0+events_unbound20:04:493
593340993725,8cyclictest612425-21grep20:00:262
593337993730,5cyclictest616050-21kworker/u8:3+events_unbound20:57:171
593337993728,4cyclictest614552-21munin-plugin-st20:10:001
593337993727,6cyclictest0-21swapper/121:55:161
593337993726,8cyclictest653991-21unixbench_singl22:00:271
593337993726,7cyclictest0-21swapper/121:00:261
593337993721,13cyclictest231ktimers/121:25:131
593337993721,13cyclictest231ktimers/121:25:131
593333993722,11cyclictest121ktimers/021:25:130
593333993722,11cyclictest121ktimers/021:25:130
593344993628,6cyclictest647086-21kworker/u8:3+events_unbound22:17:333
593340993624,7cyclictest0-21swapper/219:40:262
593340993611,7cyclictest32-21ksoftirqd/223:20:002
593337993630,4cyclictest647086-21kworker/u8:3+events_unbound23:14:421
593337993628,4cyclictest0-21swapper/119:20:241
593337993627,5cyclictest0-21swapper/123:45:181
593337993627,5cyclictest0-21swapper/123:45:181
593333993626,6cyclictest0-21swapper/000:25:000
593344993527,5cyclictest647393-21munin-plugin-st21:45:013
593344993517,6cyclictest673214-21kworker/u8:2+events_unbound23:41:223
593344993514,7cyclictest131rcu_preempt20:20:003
593344993514,7cyclictest131rcu_preempt20:20:003
593340993524,7cyclictest647410-21cat21:45:012
593340993523,8cyclictest619195-21grep20:20:262
593337993527,4cyclictest0-21swapper/123:20:001
593337993521,10cyclictest231ktimers/123:35:121
593333993526,6cyclictest0-21swapper/000:10:250
593333993524,7cyclictest0-21swapper/019:50:250
593344993426,4cyclictest0-21swapper/319:27:003
593344993418,5cyclictest681842-21kworker/u8:3+events_unbound00:00:283
593340993426,4cyclictest0-21swapper/200:10:242
593340993424,5cyclictest0-21swapper/221:35:012
593340993411,6cyclictest301rcuc/220:50:012
593337993423,7cyclictest0-21swapper/122:35:281
59333399342,6cyclictest666342-21munin-run22:40:010
593333993424,6cyclictest0-21swapper/022:55:240
593333993424,6cyclictest0-21swapper/020:35:270
593344993325,4cyclictest0-21swapper/320:50:263
593344993314,6cyclictest647086-21kworker/u8:3+events_unbound23:14:363
59334099339,6cyclictest0-21swapper/220:10:232
59334099339,6cyclictest0-21swapper/220:10:232
593340993321,8cyclictest600894-21sh19:30:012
593337993324,6cyclictest0-21swapper/123:34:591
593337993323,6cyclictest616233-21cron20:15:001
593337993323,6cyclictest616233-21cron20:15:001
593337993323,5cyclictest0-21swapper/119:10:261
593333993317,13cyclictest11-21ksoftirqd/021:20:130
593344993224,4cyclictest0-21swapper/319:30:273
593344993224,4cyclictest0-21swapper/319:10:263
593344993224,4cyclictest0-21swapper/300:05:163
593344993221,8cyclictest0-21swapper/322:10:003
593344993221,8cyclictest0-21swapper/322:10:003
593344993214,6cyclictest616050-21kworker/u8:3+events_unbound20:47:523
593344993213,5cyclictest634778-21kworker/u8:2+events_unbound22:28:373
59334099328,7cyclictest32-21ksoftirqd/219:30:202
59334099325,9cyclictest651220-21/usr/sbin/munin21:55:162
593340993223,4cyclictest0-21swapper/219:40:002
593340993221,8cyclictest675084-21auditctl23:05:002
593340993219,9cyclictest311ktimers/219:20:072
593340993219,8cyclictest0-21swapper/219:55:252
593340993210,5cyclictest32-21ksoftirqd/220:05:162
593337993226,4cyclictest611040-21kworker/u8:0+events_unbound20:27:111
593337993224,4cyclictest0-21swapper/100:00:381
593337993223,6cyclictest599640-21fschecks_time19:25:161
593337993222,6cyclictest0-21swapper/100:35:171
593337993221,7cyclictest0-21swapper/120:45:271
593333993225,3cyclictest0-21swapper/022:00:000
593344993124,4cyclictest0-21swapper/323:00:263
593344993123,4cyclictest0-21swapper/321:10:203
593344993123,4cyclictest0-21swapper/300:20:253
593344993119,7cyclictest0-21swapper/300:20:003
593344993117,5cyclictest662878-21kworker/u8:1+events_unbound22:57:423
593344993112,5cyclictest0-21swapper/322:30:123
59334099314,9cyclictest684365-21ntpq23:30:202
59334099314,10cyclictest677731-21mailstats23:10:252
593337993123,4cyclictest0-21swapper/123:50:251
593337993122,6cyclictest0-21swapper/119:40:011
593337993121,6cyclictest0-21swapper/122:25:251
593337993120,7cyclictest0-21swapper/121:50:251
593337993118,7cyclictest131rcu_preempt22:33:311
593333993124,3cyclictest0-21swapper/021:35:000
593333993123,4cyclictest0-21swapper/020:15:260
593333993123,4cyclictest0-21swapper/020:15:260
593344993023,5cyclictest666036-21kworker/u8:0+events_unbound22:44:403
593344993022,4cyclictest0-21swapper/320:10:153
593344993022,4cyclictest0-21swapper/320:10:143
593344993022,4cyclictest0-21swapper/319:45:263
593344993022,4cyclictest0-21swapper/300:35:263
59334499301,7cyclictest0-21swapper/319:50:123
59334499300,6cyclictest0-21swapper/300:30:123
59334099305,9cyclictest687256-21/usr/sbin/munin23:40:172
593340993020,6cyclictest607239-21grep19:45:262
593340993019,7cyclictest626035-21grep20:40:252
593340993016,8cyclictest0-21swapper/200:20:182
593340993016,3cyclictest131rcu_preempt21:45:302
593340993010,4cyclictest301rcuc/220:15:252
593340993010,4cyclictest301rcuc/220:15:252
59333799303,4cyclictest131rcu_preempt00:15:121
593337993021,4cyclictest0-21swapper/122:45:261
593337993018,6cyclictest616050-21kworker/u8:3+events_unbound20:21:581
593333993024,3cyclictest645-21runrttasks21:10:120
593333993022,4cyclictest0-21swapper/019:35:260
593333993021,6cyclictest607717-21sh19:50:010
59334499296,12cyclictest40-21ksoftirqd/321:35:143
593344992921,4cyclictest0-21swapper/322:15:003
593344992921,4cyclictest0-21swapper/320:37:133
59334499291,14cyclictest0-21swapper/321:46:583
59334099298,6cyclictest32-21ksoftirqd/222:35:012
59334099296,5cyclictest32-21ksoftirqd/220:40:012
59334099291,9cyclictest595606-21ntpq19:15:042
593337992923,4cyclictest662878-21kworker/u8:1+events_unbound22:52:381
593337992923,4cyclictest587740-21kworker/u8:2+events_unbound20:02:051
593337992922,4cyclictest597301-21idleruntime-cro19:20:011
593337992921,4cyclictest0-21swapper/100:20:151
593333992923,4cyclictest695218-21kworker/u8:1+events_unbound00:33:040
593333992921,4cyclictest0-21swapper/023:22:450
593333992920,6cyclictest648883-21unixbench_singl21:45:260
593333992920,6cyclictest0-21swapper/023:40:000
593333992920,5cyclictest0-21swapper/000:25:170
59334499288,3cyclictest0-21swapper/321:58:263
593344992820,6cyclictest639957-21kworker/u8:0+events_unbound21:51:593
593344992812,5cyclictest634778-21kworker/u8:2+events_unbound21:08:553
59334099289,6cyclictest609545-21cat19:55:012
59334099289,5cyclictest301rcuc/221:20:212
59334099289,14cyclictest623076-21grep20:35:012
593340992818,6cyclictest0-21swapper/223:10:002
593340992816,3cyclictest131rcu_preempt23:47:362
593340992816,3cyclictest131rcu_preempt23:47:362
593340992812,13cyclictest631838-21apt-get21:00:122
593337992821,4cyclictest587740-21kworker/u8:2+events_unbound19:41:391
593337992820,6cyclictest680110-21kworker/u8:1+events_unbound23:25:021
593337992818,6cyclictest0-21swapper/123:55:191
59333799280,4cyclictest131rcu_preempt22:15:111
593333992824,2cyclictest13550irq/42-30be0000.ethernet19:30:200
593333992819,5cyclictest0-21swapper/023:20:000
593333992818,6cyclictest0-21swapper/023:50:000
593333992818,6cyclictest0-21swapper/023:50:000
593333992818,6cyclictest0-21swapper/019:55:250
593333992818,6cyclictest0-21swapper/000:40:000
593333992810,5cyclictest131rcu_preempt23:00:120
593344992721,4cyclictest680110-21kworker/u8:1+events_unbound23:25:233
593344992721,3cyclictest0-21swapper/322:00:243
59334499271,7cyclictest611158-21awk20:00:013
59334499270,12cyclictest0-21swapper/320:31:593
59334099277,6cyclictest0-21swapper/220:55:202
59334099275,13cyclictest638418-21apt-get21:20:012
593340992720,4cyclictest659765-21apt-get22:20:112
593340992718,4cyclictest0-21swapper/220:52:152
593340992711,11cyclictest0-21swapper/221:50:162
593337992721,3cyclictest0-21swapper/121:35:001
593337992718,5cyclictest0-21swapper/121:20:231
593337992716,7cyclictest611157-21basename20:00:011
593333992723,2cyclictest13550irq/42-30be0000.ethernet21:05:130
593333992718,6cyclictest1-21systemd22:54:390
593333992716,6cyclictest0-21swapper/020:22:080
593333992715,5cyclictest587740-21kworker/u8:2+events_unbound19:15:270
59334499269,9cyclictest131rcu_preempt23:45:283
59334499269,9cyclictest131rcu_preempt23:45:283
593344992620,4cyclictest701244-21kworker/u8:0+events_unbound00:26:433
593344992619,5cyclictest587740-21kworker/u8:2+events_unbound20:05:153
59334499261,6cyclictest639881-21tail21:20:253
59334099268,5cyclictest32-21ksoftirqd/221:30:002
59334099268,5cyclictest32-21ksoftirqd/221:30:002
59334099268,5cyclictest32-21ksoftirqd/200:25:132
593340992619,4cyclictest619899-21apt-get20:25:122
593340992617,6cyclictest0-21swapper/200:20:012
593340992615,8cyclictest681165-21cat23:20:242
593340992613,10cyclictest593946-21/usr/sbin/munin19:10:212
593340992610,2cyclictest0-21swapper/221:10:172
593337992618,4cyclictest0-21swapper/120:40:251
593337992617,6cyclictest0-21swapper/121:35:261
593337992617,5cyclictest0-21swapper/119:30:211
593337992617,4cyclictest0-21swapper/100:10:011
593337992616,7cyclictest668271-21basename22:45:011
593337992616,6cyclictest0-21swapper/119:50:171
593337992616,5cyclictest0-21swapper/120:40:011
593333992620,4cyclictest690645-21kworker/u8:0+events_unbound23:53:290
593333992620,3cyclictest13550irq/42-30be0000.ethernet22:25:010
593333992619,4cyclictest0-21swapper/020:50:260
593333992618,5cyclictest0-21swapper/020:09:590
593333992618,4cyclictest0-21swapper/022:15:260
593333992618,4cyclictest0-21swapper/019:20:240
593333992618,3cyclictest0-21swapper/000:05:200
593333992617,5cyclictest0-21swapper/019:45:000
59333399261,4cyclictest663502-21irqstats22:30:180
593333992613,10cyclictest121ktimers/021:00:130
59334499257,7cyclictest40-21ksoftirqd/319:35:263
593344992518,5cyclictest690645-21kworker/u8:0+events_unbound23:57:333
593344992518,5cyclictest616050-21kworker/u8:3+events_unbound20:55:123
593344992518,3cyclictest0-21swapper/323:20:253
593344992517,4cyclictest0-21swapper/319:15:173
59334499251,14cyclictest0-21swapper/322:21:533
59334099253,10cyclictest658605-21ntp_states22:15:212
593340992517,4cyclictest0-21swapper/222:05:252
593340992517,4cyclictest0-21swapper/222:05:242
593340992513,8cyclictest707012-21grep00:35:262
593337992519,4cyclictest587740-21kworker/u8:2+events_unbound19:47:501
593337992517,4cyclictest681899-21cron23:25:001
593337992513,9cyclictest24-21ksoftirqd/120:15:451
593337992513,9cyclictest24-21ksoftirqd/120:15:451
593333992517,5cyclictest0-21swapper/020:30:270
593333992517,4cyclictest0-21swapper/021:40:010
59334499241,12cyclictest0-21swapper/321:32:223
59334499240,12cyclictest0-21swapper/320:25:113
593340992415,5cyclictest0-21swapper/221:05:162
59333799248,7cyclictest24-21ksoftirqd/123:00:211
59333799244,11cyclictest24-21ksoftirqd/121:40:151
593337992412,4cyclictest631209-21kworker/u8:1+events_unbound21:08:041
593333992418,4cyclictest647086-21kworker/u8:3+events_unbound23:12:440
593333992417,3cyclictest0-21swapper/023:44:300
593333992417,3cyclictest0-21swapper/022:04:240
593333992417,3cyclictest0-21swapper/019:25:060
593333992416,5cyclictest151rcuc/000:00:140
593333992416,5cyclictest0-21swapper/019:15:010
59334499237,4cyclictest131rcu_preempt19:20:173
59334499230,12cyclictest0-21swapper/321:03:003
593340992312,7cyclictest653693-21/usr/sbin/munin22:00:262
59333799239,8cyclictest131rcu_preempt22:05:241
59333799239,8cyclictest131rcu_preempt22:05:241
59333799237,9cyclictest690648-21kworker/u8:4+events_unbound00:10:291
59333799236,5cyclictest131rcu_preempt22:10:131
593337992315,5cyclictest0-21swapper/123:05:151
59333799231,11cyclictest0-21swapper/100:33:001
593333992318,3cyclictest13550irq/42-30be0000.ethernet22:45:160
593333992317,3cyclictest0-21swapper/022:10:160
593333992315,5cyclictest0-21swapper/023:30:210
59333399231,3cyclictest0-21swapper/020:42:110
59333799221,3cyclictest702609-21apt-get00:25:111
593333992216,4cyclictest680110-21kworker/u8:1+events_unbound23:27:480
593333992216,3cyclictest0-21swapper/022:41:480
593333992216,3cyclictest0-21swapper/020:45:210
593333992215,4cyclictest614959-21fschecks_time20:10:140
593333992215,4cyclictest614959-21fschecks_time20:10:140
59333399221,18cyclictest0-21swapper/021:52:380
59333399220,18cyclictest0-21swapper/023:06:530
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional