You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-04 - 05:51

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Phytec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackbslot5s.osadl.org (updated Mon May 04, 2026 00:44:52)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3497534995447,4cyclictest35136272sleep319:55:123
3497521995237,11cyclictest121ktimers/019:40:120
3497526994936,9cyclictest231ktimers/123:20:111
3497526994833,12cyclictest231ktimers/100:00:121
3497521994824,21cyclictest3518103-21unixbench_singl20:05:230
3497521994728,15cyclictest3561361-21grep22:10:250
3497530994637,6cyclictest3593966-21grep23:45:252
3497521994613,8cyclictest164-21systemd-journal20:02:020
3497526994536,5cyclictest3602926-21cron00:15:001
349753499421,16cyclictest0-21swapper/320:00:123
3497534994133,5cyclictest3544135-21kworker/u8:1+events_unbound22:07:223
3497534994133,5cyclictest3544135-21kworker/u8:1+events_unbound22:07:223
3497526994131,6cyclictest3531978-21grep20:45:261
3497521994116,3cyclictest13550irq/42-30be0000.ethernet22:50:250
3497521994113,6cyclictest0-21swapper/020:20:010
3497534994031,4cyclictest3527268-21munin-plugin-st20:35:013
3497534994030,5cyclictest0-21swapper/321:45:253
3497521994032,5cyclictest3563066-21grep22:15:250
3497526993930,5cyclictest3513411-21munin-plugin-st19:55:011
3497521993932,4cyclictest3587603-21idleruntime-cro23:30:000
3497521993913,5cyclictest0-21swapper/023:15:000
3497521993913,3cyclictest0-21swapper/023:35:250
3497534993828,6cyclictest3508271-21cron19:40:003
3497534993828,6cyclictest3508271-21cron19:40:003
3497526993832,3cyclictest3515105-21cron20:00:011
3497534993730,5cyclictest3582395-21kworker/u8:1+events_unbound23:27:393
3497534993729,5cyclictest3537435-21kworker/u8:3+events_unbound21:42:223
3497534993727,6cyclictest0-21swapper/323:55:023
3497521993730,4cyclictest3549688-21latency_hist21:40:020
3497521993725,8cyclictest3531368-21missed_timers20:45:210
3497534993629,4cyclictest3597820-21munin-plugin-st00:00:003
3497534993629,4cyclictest3549694-21apt-get21:40:013
3497534993619,6cyclictest3511403-21kworker/u8:1+events_unbound20:07:023
349753499361,5cyclictest6250watchdogd23:05:133
3497530993629,4cyclictest3588163-21kworker/u8:2+events_unbound23:42:422
3497521993614,5cyclictest0-21swapper/000:36:140
3497521993614,5cyclictest0-21swapper/000:36:130
349752199361,18cyclictest0-21swapper/019:53:310
3497530993525,6cyclictest0-21swapper/223:30:152
3497530993525,6cyclictest0-21swapper/223:30:152
3497526993528,4cyclictest0-21swapper/121:40:161
3497526993527,4cyclictest0-21swapper/120:30:011
3497526993526,6cyclictest3607585-21grep00:25:231
3497526993525,7cyclictest3578631-21grep23:00:251
3497526993525,7cyclictest3578631-21grep23:00:251
3497526993525,7cyclictest3518036-21grep20:05:231
3497521993525,7cyclictest3584172-21apt23:20:000
3497521993515,5cyclictest0-21swapper/020:22:280
3497521993515,3cyclictest0-21swapper/021:26:180
3497534993428,4cyclictest3566893-21kworker/u8:3+events_unbound22:32:273
3497534993426,4cyclictest0-21swapper/321:55:253
3497534993424,6cyclictest3609970-21apt00:35:003
3497534993423,8cyclictest3546238-21idleruntime-cro21:30:013
3497534993423,7cyclictest0-21swapper/322:15:003
349752699346,10cyclictest3556906-21chrt22:00:031
3497526993426,4cyclictest0-21swapper/120:25:011
3497526993422,8cyclictest0-21swapper/122:10:241
3497521993426,4cyclictest0-21swapper/019:45:250
3497534993323,6cyclictest0-21swapper/323:50:003
3497534993322,7cyclictest0-21swapper/321:25:013
3497530993324,4cyclictest0-21swapper/219:35:172
3497530993324,4cyclictest0-21swapper/219:35:172
3497530993324,4cyclictest0-21swapper/219:15:252
3497530993322,6cyclictest3568193-21unixbench_singl22:30:262
349752699339,5cyclictest24-21ksoftirqd/123:15:001
3497521993324,6cyclictest3508277-21auditctl19:40:000
3497521993324,6cyclictest3508277-21auditctl19:40:000
3497521993321,7cyclictest3543859-21grep21:20:240
3497521993320,10cyclictest121ktimers/020:50:120
3497534993227,3cyclictest0-21swapper/323:35:133
3497534993224,6cyclictest3577151-21kworker/u8:3+events_unbound23:02:353
3497534993224,6cyclictest3577151-21kworker/u8:3+events_unbound23:02:353
3497534993224,4cyclictest0-21swapper/322:25:143
3497534993224,4cyclictest0-21swapper/320:40:253
3497534993223,6cyclictest3523634-21cron20:25:013
3497534993222,6cyclictest0-21swapper/322:50:153
3497534993222,5cyclictest0-21swapper/300:08:453
3497530993225,4cyclictest0-21swapper/219:45:002
3497530993224,6cyclictest3530345-21kworker/u8:2+events_unbound21:22:172
3497530993221,7cyclictest3545833-21grep21:25:252
3497521993223,6cyclictest0-21swapper/023:55:250
3497521993216,3cyclictest0-21swapper/019:57:310
3497534993125,4cyclictest3367459-21kworker/u8:2+events_unbound19:16:553
3497534993122,4cyclictest0-21swapper/320:45:143
3497534993120,7cyclictest3599534-21auditctl00:05:003
3497534993119,7cyclictest0-21swapper/300:40:013
3497534993119,7cyclictest0-21swapper/300:40:003
3497530993124,5cyclictest3558253-21kworker/u8:2+events_unbound22:12:242
3497530993123,4cyclictest0-21swapper/222:55:002
3497530993123,4cyclictest0-21swapper/220:45:262
3497530993120,7cyclictest3499404-21sed19:15:012
3497530993117,11cyclictest311ktimers/221:35:152
3497526993124,4cyclictest3521952-21sendmail20:20:011
3497526993123,5cyclictest3576928-21unixbench_singl22:55:251
3497526993123,5cyclictest3576928-21unixbench_singl22:55:241
3497526993123,4cyclictest0-21swapper/123:40:171
3497526993123,4cyclictest0-21swapper/120:40:251
3497526993119,8cyclictest3582920-21fschecks_time23:15:171
3497521993119,9cyclictest121ktimers/022:40:140
3497534993024,4cyclictest3520575-21kworker/u8:0+events_unbound20:27:093
3497534993022,5cyclictest3585537-21kworker/u8:0+events_unbound23:21:123
3497530993023,3cyclictest0-21swapper/223:15:262
3497530993022,4cyclictest0-21swapper/222:35:182
3497530993022,4cyclictest0-21swapper/220:40:252
3497530993020,6cyclictest0-21swapper/222:20:142
3497526993022,4cyclictest0-21swapper/123:45:161
3497526993021,5cyclictest3590534-21unixbench_multi23:35:261
3497526993021,4cyclictest0-21swapper/122:25:151
3497526993013,10cyclictest3497515-21cyclictest21:19:191
3497534992922,5cyclictest3501253-21kworker/u8:3+events_unbound19:52:023
3497534992916,8cyclictest3564803-21grep22:20:253
3497526992923,3cyclictest0-21swapper/121:10:011
3497526992922,4cyclictest3499986-21apt-get19:15:141
3497521992920,5cyclictest3588455-21seq23:30:220
3497521992920,5cyclictest3588455-21seq23:30:220
349752199290,27cyclictest0-21swapper/021:40:120
3497534992821,5cyclictest3577151-21kworker/u8:3+events_unbound23:44:423
3497534992821,5cyclictest3491798-21kworker/u8:1+events_unbound19:14:463
3497534992820,5cyclictest3501253-21kworker/u8:3+events_unbound20:51:303
3497534992818,6cyclictest3608073-21basename00:30:003
3497534992817,7cyclictest0-21swapper/319:20:253
3497530992820,5cyclictest3596351-21kworker/u8:0+events_unbound00:29:002
3497530992820,4cyclictest0-21swapper/222:07:222
3497530992820,4cyclictest0-21swapper/222:07:222
3497530992820,4cyclictest0-21swapper/220:00:262
349752699288,4cyclictest24-21ksoftirqd/120:30:171
3497526992820,6cyclictest231ktimers/122:50:061
3497526992818,6cyclictest0-21swapper/122:35:281
3497526992817,5cyclictest131rcu_preempt19:41:211
3497526992816,3cyclictest131rcu_preempt22:07:211
3497526992816,3cyclictest131rcu_preempt22:07:211
3497526992815,10cyclictest3567488-21/usr/sbin/munin22:30:191
3497526992815,10cyclictest3543893-21awk21:20:241
3497526992814,8cyclictest3501253-21kworker/u8:3-events_unbound19:32:111
3497526992814,8cyclictest3501253-21kworker/u8:3-events_unbound19:32:111
349752199281,24cyclictest0-21swapper/021:18:540
349752199280,26cyclictest0-21swapper/023:50:110
3497534992721,3cyclictest0-21swapper/320:55:163
3497534992720,5cyclictest3501253-21kworker/u8:3+events_unbound19:45:133
3497534992718,6cyclictest3603947-21cat00:15:243
349753499271,7cyclictest3573727-21cron22:50:013
3497530992720,4cyclictest0-21swapper/223:25:002
3497530992717,6cyclictest0-21swapper/219:20:252
3497530992716,8cyclictest3611696-21basename00:40:002
3497530992716,8cyclictest3611696-21basename00:40:002
3497530992716,7cyclictest3526800-21grep20:30:252
349752699277,14cyclictest3589445-21latency_hist23:35:001
349752699277,14cyclictest3589445-21latency_hist23:35:001
3497526992719,4cyclictest0-21swapper/122:45:011
3497526992717,7cyclictest3510785-21/usr/sbin/munin19:45:211
3497526992716,8cyclictest3599767-21apt-get00:05:141
3497526992716,7cyclictest3533373-21/usr/sbin/munin20:50:241
3497521992721,3cyclictest0-21swapper/021:10:010
3497521992718,5cyclictest0-21swapper/019:25:170
3497521992718,5cyclictest0-21swapper/000:25:230
3497521992717,7cyclictest3580364-21unixbench_singl23:05:260
3497521992716,8cyclictest3559608-21grep22:05:250
3497521992716,8cyclictest3559608-21grep22:05:250
3497534992619,4cyclictest3501253-21kworker/u8:3+events_unbound19:31:043
3497534992619,4cyclictest3501253-21kworker/u8:3+events_unbound19:31:043
3497534992618,4cyclictest0-21swapper/320:10:163
3497534992618,3cyclictest0-21swapper/300:20:253
349753099266,4cyclictest131rcu_preempt22:20:002
3497530992620,3cyclictest0-21swapper/221:00:142
3497530992619,3cyclictest0-21swapper/221:15:002
3497530992618,4cyclictest3511698-21auditctl19:50:002
3497530992618,4cyclictest0-21swapper/200:20:262
3497530992617,6cyclictest3577359-21sendmail23:00:012
3497530992617,6cyclictest3577359-21sendmail23:00:002
3497530992615,8cyclictest3541562-21cat21:15:192
349752699268,9cyclictest131rcu_preempt23:59:061
349752699268,4cyclictest24-21ksoftirqd/121:45:321
349752699268,11cyclictest131rcu_preempt22:15:231
349752699267,13cyclictest3537679-21wc21:05:011
3497526992618,4cyclictest0-21swapper/119:20:251
3497526992618,4cyclictest0-21swapper/100:40:001
3497526992618,4cyclictest0-21swapper/100:40:001
3497526992616,7cyclictest3553502-21apt-get21:50:131
3497526992616,7cyclictest3518755-21apt-get20:10:141
3497526992616,3cyclictest131rcu_preempt20:57:151
3497526992613,10cyclictest3564517-21/usr/sbin/munin22:20:241
3497526992612,7cyclictest131rcu_preempt21:29:331
3497521992619,4cyclictest3570306-21cron22:40:000
3497521992619,3cyclictest0-21swapper/021:55:250
349752199261,8cyclictest3554347-21wc21:50:240
3497521992618,5cyclictest0-21swapper/019:20:250
3497521992615,8cyclictest3606366-21basename00:25:000
3497534992518,5cyclictest3540870-21kworker/u8:0+events_unbound21:15:143
3497534992518,4cyclictest438-21cron21:35:013
3497534992516,5cyclictest3528541-21grep20:35:263
349753499251,4cyclictest3509986-21cron19:45:003
3497534992514,7cyclictest164-21systemd-journal23:14:403
3497530992517,4cyclictest0-21swapper/222:25:142
3497530992516,6cyclictest3535088-21grep20:55:232
3497530992515,7cyclictest3589623-21ls23:35:142
349752699259,9cyclictest131rcu_preempt21:57:001
3497526992518,4cyclictest3604235-21head00:15:251
3497526992518,4cyclictest3587597-21latency_hist23:30:001
3497526992516,4cyclictest131rcu_preempt19:36:441
3497526992516,4cyclictest131rcu_preempt19:36:441
3497526992515,7cyclictest3516647-21cron20:03:021
3497526992513,5cyclictest131rcu_preempt23:51:211
3497526992512,7cyclictest131rcu_preempt19:12:401
3497526992510,4cyclictest131rcu_preempt19:25:241
3497526992510,12cyclictest3572848-21/usr/sbin/munin22:45:231
3497521992517,5cyclictest0-21swapper/021:30:160
3497521992517,5cyclictest0-21swapper/000:00:160
3497521992514,8cyclictest3499284-21munin-node19:15:010
3497534992416,5cyclictest0-21swapper/322:55:243
3497534992416,5cyclictest0-21swapper/322:55:243
3497534992413,7cyclictest204-21dbus-daemon23:17:363
3497534992413,7cyclictest1-21systemd23:32:403
3497534992413,7cyclictest1-21systemd23:32:393
3497530992418,3cyclictest0-21swapper/222:00:142
3497530992417,4cyclictest0-21swapper/200:15:222
3497530992416,5cyclictest0-21swapper/221:05:282
3497530992415,6cyclictest0-21swapper/223:00:252
3497530992415,6cyclictest0-21swapper/223:00:252
349752699241,7cyclictest3609066-21ntpq00:30:221
3497526992417,3cyclictest0-21swapper/120:35:261
3497526992416,5cyclictest0-21swapper/100:20:261
3497526992415,6cyclictest231ktimers/121:39:021
3497526992413,9cyclictest3539873-21/usr/sbin/munin21:10:181
3497521992418,4cyclictest3537513-21idleruntime-cro21:05:000
3497521992417,4cyclictest0-21swapper/023:00:260
3497521992417,4cyclictest0-21swapper/023:00:250
3497521992414,6cyclictest3527707-21uniq20:35:170
349752199241,21cyclictest0-21swapper/019:31:050
349752199241,21cyclictest0-21swapper/019:31:050
349752199241,19cyclictest0-21swapper/020:57:380
349752199241,19cyclictest0-21swapper/019:17:570
349752199241,19cyclictest0-21swapper/000:13:290
349753499237,6cyclictest3544135-21kworker/u8:1+events_unbound22:03:503
3497534992316,5cyclictest3582395-21kworker/u8:1+events_unbound00:10:133
3497534992316,4cyclictest3504413-21grep19:25:253
3497534992316,3cyclictest0-21swapper/320:15:263
3497534992315,5cyclictest3530345-21kworker/u8:2+events_unbound21:05:243
3497530992317,3cyclictest0-21swapper/223:55:182
3497530992317,3cyclictest0-21swapper/221:40:242
3497530992317,3cyclictest0-21swapper/220:30:012
3497530992316,4cyclictest0-21swapper/220:10:262
3497530992313,7cyclictest3528503-21grep20:35:262
3497526992313,4cyclictest131rcu_preempt21:30:201
3497521992316,3cyclictest0-21swapper/000:18:190
3497521992315,6cyclictest121ktimers/022:20:110
349752199231,3cyclictest3594322-21cron23:49:000
349752199231,18cyclictest0-21swapper/022:57:520
349752199231,18cyclictest0-21swapper/022:57:520
349752199231,18cyclictest0-21swapper/022:28:410
349752199231,18cyclictest0-21swapper/021:13:380
349752199230,19cyclictest0-21swapper/023:24:310
349752199230,19cyclictest0-21swapper/021:47:260
349752199230,19cyclictest0-21swapper/020:25:250
3497534992213,5cyclictest0-21swapper/321:00:193
3497534992212,7cyclictest391ktimers/322:15:183
3497534992212,6cyclictest0-21swapper/322:35:213
3497530992216,3cyclictest0-21swapper/220:15:172
3497530992216,3cyclictest0-21swapper/219:55:202
3497530992215,5cyclictest2719660-1kworker/2:2H+kblockd23:50:002
3497530992213,6cyclictest3571445-21grep22:40:252
3497530992212,8cyclictest3599589-21sed00:05:012
3497530992212,7cyclictest204-21dbus-daemon21:52:212
3497521992215,3cyclictest0-21swapper/020:30:240
3497521992214,5cyclictest3529631-21latency20:40:180
349752199221,3cyclictest0-21swapper/020:10:140
349752199221,3cyclictest0-21swapper/000:09:410
349752199220,18cyclictest0-21swapper/022:32:450
349752199220,18cyclictest0-21swapper/022:01:470
3497534992115,3cyclictest0-21swapper/322:45:003
3497530992115,3cyclictest0-21swapper/223:30:002
3497530992115,3cyclictest0-21swapper/223:05:212
3497530992115,3cyclictest0-21swapper/219:25:242
3497530992115,3cyclictest0-21swapper/200:30:162
3497530992114,4cyclictest0-21swapper/219:50:252
3497530992113,5cyclictest311ktimers/220:20:242
3497530992113,4cyclictest0-21swapper/221:55:252
3497530992112,7cyclictest3573764-21latency_hist22:50:012
3497521992115,3cyclictest0-21swapper/022:45:170
3497530992014,3cyclictest3506579-21idleruntime-cro19:35:022
3497530992014,3cyclictest3506579-21idleruntime-cro19:35:012
3497530992013,5cyclictest311ktimers/220:05:112
3497530991912,5cyclictest311ktimers/220:50:142
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional