You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-26 - 07:20

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Phytec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot5s.osadl.org (updated Wed Aug 26, 2026 00:44:47)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
921822995042,6cyclictest939474-21kworker/u8:3+events_unbound20:20:573
921822995039,7cyclictest208-21systemd-logind20:56:013
921815994943,4cyclictest1023213-21kworker/u8:0+events_unbound00:38:031
921822994838,6cyclictest1009538-21munin-plugin-st23:20:013
921822994837,6cyclictest1030429-21munin-run00:20:003
921815994841,5cyclictest1033739-21kworker/u8:2+events_unbound00:31:541
921810994841,4cyclictest956895-21unixbench_singl20:45:280
92182299479,16cyclictest976690-21latency_hist21:45:023
921810994635,7cyclictest934309-21grep19:40:270
921822994530,8cyclictest0-21swapper/323:55:003
921822994523,4cyclictest988675-21idleruntime-cro22:20:003
921815994538,5cyclictest1014169-21kworker/u8:1+events_unbound23:56:401
92181099458,7cyclictest131rcu_preempt00:35:120
921822994432,6cyclictest0-21swapper/320:20:013
921815994433,8cyclictest943244-21munin-run20:10:011
921810994437,4cyclictest932789-21idleruntime-cro19:40:000
921822994331,8cyclictest929799-21fschecks_time19:30:173
921819994334,6cyclictest995907-21sendmail22:40:002
921815994236,4cyclictest957041-21kworker/u8:1+events_unbound20:51:021
921810994231,7cyclictest925342-21grep19:15:270
921822994132,6cyclictest956875-21unixbench_singl20:45:283
92181999411,15cyclictest0-21swapper/223:55:122
92182299408,14cyclictest993612-21sed22:30:263
92182299408,14cyclictest993612-21sed22:30:263
92182299407,14cyclictest938279-21latency_hist19:55:023
921822994032,4cyclictest0-21swapper/319:15:193
921822994031,5cyclictest932806-21sendmail19:40:003
921822994030,6cyclictest0-21swapper/320:05:003
921822994028,9cyclictest391ktimers/319:55:123
921822994027,9cyclictest391ktimers/322:40:123
921819994034,4cyclictest1031953-21kworker/u8:1+events_unbound00:26:462
92181099402,11cyclictest11-21ksoftirqd/023:35:120
921822993926,8cyclictest923002-21grep19:10:253
921819993930,6cyclictest944739-21grep20:10:262
921819993929,6cyclictest0-21swapper/200:35:012
921819993925,10cyclictest311ktimers/223:45:132
921815993932,5cyclictest920220-21kworker/u8:2+events_unbound19:15:451
921815993927,8cyclictest231ktimers/119:35:131
921819993830,4cyclictest0-21swapper/221:45:012
921819993827,7cyclictest0-21swapper/220:30:272
921815993831,4cyclictest975238-21fschecks_time21:40:161
921810993827,7cyclictest963887-21grep21:05:340
921815993726,7cyclictest0-21swapper/121:05:341
921810993729,4cyclictest0-21swapper/020:30:230
921822993625,8cyclictest979911-21idleruntime-cro21:55:003
921815993620,7cyclictest985171-21kworker/u8:2+events_unbound22:30:031
921815993620,7cyclictest985171-21kworker/u8:2+events_unbound22:30:031
921815993619,11cyclictest974530-21kworker/u8:0+events_unbound21:55:011
92181099363,9cyclictest11-21ksoftirqd/019:25:130
92181099363,9cyclictest11-21ksoftirqd/019:25:120
92182299356,12cyclictest1016616-21latency_hist23:40:003
921822993527,4cyclictest0-21swapper/300:05:273
921810993529,3cyclictest0-21swapper/022:15:000
921810993528,3cyclictest0-21swapper/022:50:260
921810993524,7cyclictest0-21swapper/000:20:000
921822993425,5cyclictest0-21swapper/321:40:013
921822993422,9cyclictest1027253-21apt-get00:10:123
921822993421,9cyclictest0-21swapper/321:25:263
921822993410,8cyclictest40-21ksoftirqd/319:25:143
921822993410,8cyclictest40-21ksoftirqd/319:25:143
921822993410,6cyclictest40-21ksoftirqd/300:35:243
921819993426,4cyclictest0-21swapper/200:15:282
921819993424,6cyclictest0-21swapper/223:15:242
921815993428,4cyclictest971049-21kworker/u8:1+events_unbound21:26:101
921815993426,4cyclictest0-21swapper/119:55:161
921810993428,4cyclictest957041-21kworker/u8:1+events_unbound21:01:050
92182299334,8cyclictest0-21swapper/321:59:043
921822993324,5cyclictest0-21swapper/322:35:143
921822993324,4cyclictest0-21swapper/320:35:263
921822993322,7cyclictest1011044-21grep23:20:283
921822993322,7cyclictest1011044-21grep23:20:273
921819993327,4cyclictest964131-21kworker/u8:3+events_unbound21:11:072
921819993327,4cyclictest916449-21kworker/u8:1+events_unbound19:30:472
921819993325,4cyclictest0-21swapper/219:35:172
921815993327,3cyclictest0-21swapper/121:05:011
921815993323,6cyclictest0-21swapper/120:25:001
921815993315,12cyclictest997533-21kworker/u8:0+events_unbound22:45:421
921810993318,5cyclictest1007473-21kworker/u8:2+events_unbound23:17:530
921822993223,5cyclictest943241-21kthreadd20:10:003
921822993222,5cyclictest0-21swapper/323:00:253
921822993222,5cyclictest0-21swapper/300:30:273
921822993219,9cyclictest1-21systemd19:20:443
92181999323,4cyclictest131rcu_preempt21:35:112
921819993224,4cyclictest0-21swapper/221:55:242
921819993222,6cyclictest934312-21unixbench_singl19:40:262
921819993222,6cyclictest204-21dbus-daemon00:37:302
921819993221,8cyclictest962635-21apt-key21:05:012
921815993225,4cyclictest0-21swapper/119:20:271
921810993226,3cyclictest0-21swapper/023:00:010
921810993225,4cyclictest0-21swapper/023:10:110
92182299316,8cyclictest1-21systemd20:10:553
921822993119,8cyclictest1-21systemd23:31:353
921819993122,5cyclictest0-21swapper/219:15:262
92181999311,6cyclictest32-21ksoftirqd/222:05:142
921819993114,7cyclictest0-21swapper/220:05:252
921819993113,9cyclictest0-21swapper/220:20:162
921819993112,11cyclictest957041-21kworker/u8:1+events_unbound21:05:202
921815993125,4cyclictest995780-21kworker/u8:1+events_unbound23:06:281
921815993116,6cyclictest1023213-21kworker/u8:0+events_unbound00:10:411
921815993114,11cyclictest1014169-21kworker/u8:1+events_unbound23:38:521
92181099319,5cyclictest995780-21kworker/u8:1+events_unbound23:00:180
921810993124,5cyclictest978059-21kworker/u8:2+events_unbound21:51:410
921810993124,3cyclictest0-21swapper/021:00:000
921810993124,3cyclictest0-21swapper/000:05:270
921810993122,6cyclictest0-21swapper/022:20:010
921810993120,7cyclictest999296-21cron22:50:010
921822993020,7cyclictest961079-21diskstats21:00:143
921822993019,8cyclictest998993-21sshd22:46:233
921822993017,10cyclictest965113-21/usr/sbin/munin21:10:183
921822993015,12cyclictest984940-21sendmail-mta22:06:293
921822993013,12cyclictest0-21swapper/320:50:133
92181999308,4cyclictest131rcu_preempt21:20:272
921819993023,4cyclictest0-21swapper/200:10:012
921819993023,4cyclictest0-21swapper/200:00:162
921819993022,4cyclictest0-21swapper/223:55:012
921819993022,4cyclictest0-21swapper/220:50:322
921819993017,6cyclictest1007473-21kworker/u8:2+events_unbound23:20:522
921819993017,6cyclictest1007473-21kworker/u8:2+events_unbound23:20:522
921819993012,10cyclictest978059-21kworker/u8:2+events_unbound21:53:422
92181599308,10cyclictest24-21ksoftirqd/119:25:211
92181599308,10cyclictest24-21ksoftirqd/119:25:211
921815993023,4cyclictest0-21swapper/119:30:281
921815993022,5cyclictest1021673-21cron23:55:011
921815993019,7cyclictest983112-21grep22:00:261
921810993023,4cyclictest0-21swapper/020:20:010
921810993022,4cyclictest0-21swapper/023:50:000
92181099301,18cyclictest0-21swapper/020:25:230
921822992919,7cyclictest989309-21/usr/sbin/munin22:20:153
921822992919,7cyclictest985589-21/usr/sbin/munin22:10:163
921822992918,8cyclictest1024115-21/usr/sbin/munin00:00:183
921822992917,9cyclictest955627-21basename20:45:013
921822992913,12cyclictest1006902-21tr23:10:213
921822992913,10cyclictest0-21swapper/322:25:143
921822992911,15cyclictest1001730-21sed22:55:203
92181999299,3cyclictest927206-21grep19:20:272
921819992923,3cyclictest0-21swapper/222:30:002
921819992922,3cyclictest0-21swapper/222:40:242
921819992919,7cyclictest1002240-21grep22:55:262
921819992914,8cyclictest131rcu_preempt22:45:142
921819992910,8cyclictest204-21dbus-daemon22:21:182
92181599298,4cyclictest131rcu_preempt21:15:121
92181599296,5cyclictest131rcu_preempt22:25:171
92181599295,4cyclictest9513922ps20:30:241
921815992923,3cyclictest0-21swapper/121:20:271
921815992922,5cyclictest974530-21kworker/u8:0+events_unbound21:55:111
921815992921,4cyclictest0-21swapper/120:55:301
921815992918,8cyclictest1-21systemd00:06:401
92181099293,5cyclictest131rcu_preempt22:25:150
921810992923,4cyclictest974530-21kworker/u8:0+events_unbound21:59:130
921810992921,6cyclictest944838-21kworker/u8:0+events_unbound20:40:130
921810992919,7cyclictest982631-21ntp_states22:00:230
921810992914,8cyclictest131rcu_preempt19:15:000
921810992913,9cyclictest131rcu_preempt23:50:220
921822992822,3cyclictest1022127-21apt-get23:55:133
921822992818,7cyclictest1005779-21cron23:06:003
921822992816,10cyclictest969087-21/usr/sbin/munin21:20:263
92181999285,3cyclictest131rcu_preempt21:00:012
921819992822,4cyclictest985171-21kworker/u8:2+events_unbound22:31:222
921819992822,4cyclictest985171-21kworker/u8:2+events_unbound22:31:222
921819992821,5cyclictest1028315-21unixbench_singl00:10:252
921819992821,3cyclictest0-21swapper/223:40:262
921819992820,5cyclictest0-21swapper/223:40:002
921815992822,4cyclictest946508-21kworker/u8:2+events_unbound20:35:191
921815992822,3cyclictest0-21swapper/120:20:001
921815992821,5cyclictest1007473-21kworker/u8:2+events_unbound23:12:181
921815992821,5cyclictest1004111-21kworker/u8:2+events_unbound23:03:361
921815992820,5cyclictest0-21swapper/123:20:281
921815992820,5cyclictest0-21swapper/123:20:271
92181599281,12cyclictest0-21swapper/120:45:351
92181099288,5cyclictest131rcu_preempt21:10:130
921810992821,5cyclictest943229-21cron20:10:080
921810992821,5cyclictest916449-21kworker/u8:1+events_unbound20:00:220
921810992821,4cyclictest0-21swapper/023:40:260
921810992820,5cyclictest0-21swapper/000:00:270
921810992819,5cyclictest0-21swapper/023:10:000
921810992815,4cyclictest131rcu_preempt21:35:010
921810992812,3cyclictest131rcu_preempt21:15:210
921822992718,6cyclictest999657-21/usr/sbin/munin22:50:163
921822992717,7cyclictest971955-21/usr/sbin/munin21:30:193
921822992717,7cyclictest966931-21/usr/sbin/munin21:15:203
921822992717,7cyclictest949488-21memory20:25:343
921822992717,7cyclictest935073-21/usr/sbin/munin19:45:173
921822992717,7cyclictest1016897-21/usr/sbin/munin23:40:143
921822992717,6cyclictest0-21swapper/320:34:593
921822992714,8cyclictest963046-21cut21:05:253
92181999275,15cyclictest0-21swapper/220:19:322
921819992720,3cyclictest0-21swapper/220:00:262
921819992719,3cyclictest0-21swapper/221:15:232
921819992717,4cyclictest131rcu_preempt23:00:172
921819992715,4cyclictest131rcu_preempt22:15:202
92181999270,3cyclictest131rcu_preempt23:30:002
92181999270,3cyclictest131rcu_preempt23:29:592
92181599278,5cyclictest24-21ksoftirqd/122:40:111
921815992719,6cyclictest983453-21kworker/u8:1+events_unbound22:07:411
921815992719,6cyclictest53-21kcompactd022:20:061
921815992719,5cyclictest0-21swapper/119:45:261
921815992718,6cyclictest0-21swapper/123:30:271
921815992714,9cyclictest1-21systemd22:16:181
921815992711,4cyclictest131rcu_preempt19:50:121
921810992721,4cyclictest938080-21kworker/u8:2+events_unbound19:55:520
921810992719,6cyclictest1011837-21kworker/u8:0+events_unbound23:28:080
921810992719,6cyclictest1011837-21kworker/u8:0+events_unbound23:28:070
921810992719,5cyclictest0-21swapper/021:30:010
921810992718,7cyclictest1031717-21unixbench_singl00:20:260
921810992718,7cyclictest1007473-21kworker/u8:2+events_unbound23:21:410
921810992718,7cyclictest1007473-21kworker/u8:2+events_unbound23:21:400
921810992717,6cyclictest1014399-21grep23:30:270
92182299268,14cyclictest1018695-21fschecks_count23:45:153
921822992619,4cyclictest0-21swapper/300:25:243
921822992616,7cyclictest982440-21/usr/sbin/munin22:00:203
921822992616,7cyclictest933969-21/usr/sbin/munin19:40:263
921822992613,9cyclictest1011905-21grep23:25:153
921822992613,9cyclictest1011905-21grep23:25:153
92181999267,11cyclictest4002823-21kworker/2:2-mm_percpu_wq20:36:122
92181999265,3cyclictest131rcu_preempt19:50:262
921819992619,5cyclictest944838-21kworker/u8:0+events_unbound20:45:142
921819992619,5cyclictest1023213-21kworker/u8:0+events_unbound00:20:422
921819992619,3cyclictest0-21swapper/220:00:012
921819992618,4cyclictest0-21swapper/220:40:292
921819992617,7cyclictest974530-21kworker/u8:0+events_unbound22:01:172
921819992612,7cyclictest972777-21kworker/u8:2+events_unbound21:32:542
921819992610,4cyclictest131rcu_preempt23:30:172
92181599269,10cyclictest221rcuc/121:35:011
92181599261,9cyclictest940501-21date20:00:191
921815992619,5cyclictest1017933-21kworker/u8:2+events_unbound23:47:421
921815992618,6cyclictest999273-21kworker/u8:2+events_unbound22:50:151
921815992616,7cyclictest1001925-21fgrep22:55:231
921815992615,8cyclictest0-21swapper/120:10:151
921815992615,7cyclictest0-21swapper/100:20:261
92181599261,13cyclictest0-21swapper/121:35:541
92181599261,12cyclictest24-21ksoftirqd/121:49:061
92181599261,12cyclictest0-21swapper/121:10:171
92181099267,4cyclictest131rcu_preempt19:55:010
92181099266,3cyclictest131rcu_preempt00:15:000
92181099264,3cyclictest131rcu_preempt20:50:200
92181099264,3cyclictest11-21ksoftirqd/022:40:250
921810992620,4cyclictest974530-21kworker/u8:0+events_unbound21:45:200
92181099261,12cyclictest0-21swapper/021:21:070
92181099260,18cyclictest0-21swapper/020:08:480
92182299258,14cyclictest1030916-21sort00:20:173
921822992515,6cyclictest978204-21latency_hist21:50:003
92181999256,12cyclictest32-21ksoftirqd/220:25:382
921819992515,7cyclictest923170-21seq19:11:512
92181599257,6cyclictest24-21ksoftirqd/123:40:141
92181599252,12cyclictest24-21ksoftirqd/119:44:031
921815992518,4cyclictest0-21swapper/100:25:271
921815992517,6cyclictest944838-21kworker/u8:0+events_unbound20:40:261
921815992517,5cyclictest0-21swapper/100:20:011
921810992517,4cyclictest930597-21grep19:30:270
921810992515,6cyclictest1023144-21grep23:55:250
921810992515,6cyclictest0-21swapper/020:40:010
92181099251,20cyclictest0-21swapper/021:44:280
92181099251,20cyclictest0-21swapper/000:25:240
92181999249,8cyclictest131rcu_preempt22:50:162
92181999246,10cyclictest0-21swapper/219:45:152
921819992418,3cyclictest0-21swapper/223:05:142
921819992418,3cyclictest0-21swapper/222:10:242
921819992417,5cyclictest976278-21kworker/u8:1+events_unbound21:45:092
921819992414,7cyclictest928104-21cut19:25:172
921819992414,7cyclictest928104-21cut19:25:172
921815992418,4cyclictest1024943-21kworker/u8:2+events_unbound00:02:161
921815992410,4cyclictest131rcu_preempt19:14:291
92181099245,13cyclictest11-21ksoftirqd/021:35:170
92181099243,3cyclictest131rcu_preempt19:45:140
92181099243,13cyclictest0-21swapper/022:35:520
921810992417,4cyclictest984329-21ntpq22:05:220
92181099241,3cyclictest131rcu_preempt22:20:240
921819992313,7cyclictest1006474-21diskstats23:10:142
92181599236,9cyclictest24-21ksoftirqd/122:14:591
921815992317,4cyclictest989523-21kworker/u8:3+events_unbound22:35:411
921815992316,5cyclictest1009407-21kworker/u8:3+events_unbound23:29:421
921815992316,5cyclictest1009407-21kworker/u8:3+events_unbound23:29:421
921815992316,4cyclictest0-21swapper/120:25:391
92181099236,6cyclictest11-21ksoftirqd/022:30:160
92181099236,6cyclictest11-21ksoftirqd/022:30:150
921810992313,7cyclictest947162-21awk20:20:140
921810992213,6cyclictest121ktimers/000:30:140
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional