You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-07-01 - 05:32

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Phytec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackbslot5s.osadl.org (updated Tue Jul 01, 2025 00:44:50)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
4074612995736,18cyclictest4085594-21sendmail19:40:011
4074617995342,7cyclictest4169548-21grep23:40:252
4074620995037,9cyclictest391ktimers/319:20:193
4074612994718,25cyclictest0-21swapper/123:40:171
4074620994533,9cyclictest391ktimers/319:45:143
4074612994536,5cyclictest4141014-21munin-plugin-st22:20:011
4074607994540,3cyclictest0-21swapper/023:45:140
4074612994435,6cyclictest4093864-21unixbench_multi20:00:261
4074607994436,4cyclictest0-21swapper/021:20:010
4074612994318,21cyclictest0-21swapper/119:20:311
4074612994218,20cyclictest0-21swapper/123:00:261
4074612994214,5cyclictest0-21swapper/122:30:001
4074612994214,4cyclictest4175985-21fschecks_time00:00:161
4074612994213,5cyclictest0-21swapper/120:40:001
4074607994236,4cyclictest4181314-21munin-run00:20:010
4074620994130,8cyclictest391ktimers/323:10:133
4074620994128,9cyclictest391ktimers/322:40:153
4074620994126,11cyclictest391ktimers/323:05:173
4074620994126,11cyclictest391ktimers/323:05:163
4074617994133,5cyclictest4085114-21unixbench_multi19:35:322
4074617994131,5cyclictest0-21swapper/222:20:022
4074607994133,5cyclictest4163210-21munin-plugin-st23:25:010
4074617994032,5cyclictest4127166-21idleruntime-cro21:40:002
4074612994029,8cyclictest4188268-21latency_hist00:40:021
4074620993929,6cyclictest4085112-21grep19:35:323
4074607993931,4cyclictest0-21swapper/000:00:000
4074620993829,4cyclictest0-21swapper/321:40:003
4074607993831,3cyclictest0-21swapper/022:45:000
4074620993729,5cyclictest4154646-21cron23:00:003
4074620993727,6cyclictest0-21swapper/323:55:003
4074617993730,4cyclictest4114329-21unixbench_multi21:00:272
4074617993724,9cyclictest311ktimers/223:55:132
4074617993723,10cyclictest311ktimers/222:20:162
4074617993718,6cyclictest4144420-21kworker/u8:2+events_unbound22:37:422
4074612993730,4cyclictest4154660-21munin-plugin-st23:00:001
4074612993729,5cyclictest4168306-21cron23:40:001
4074612993714,4cyclictest4107975-21sh20:45:001
4074620993628,6cyclictest4099303-21kworker/u8:0+events_unbound20:22:513
4074620993627,5cyclictest0-21swapper/320:15:023
4074620993626,6cyclictest0-21swapper/300:25:013
4074617993628,4cyclictest0-21swapper/200:05:012
4074612993627,5cyclictest0-21swapper/119:20:001
4074612993626,6cyclictest0-21swapper/122:35:291
4074612993625,7cyclictest4128453-21grep21:40:261
407461299361,19cyclictest4127157-21sh21:40:011
4074612993611,3cyclictest0-21swapper/100:00:001
4074607993626,7cyclictest4161008-21unixbench_multi23:15:250
4074607993624,9cyclictest121ktimers/020:50:130
4074620993526,5cyclictest0-21swapper/320:40:013
4074617993529,4cyclictest4133948-21kworker/u8:0+events_unbound21:58:012
4074617993529,4cyclictest4133948-21kworker/u8:0+events_unbound21:58:002
4074617993528,5cyclictest4116162-21kworker/u8:1+events_unbound21:07:562
4074617993528,5cyclictest4116162-21kworker/u8:1+events_unbound21:07:552
4074617993527,4cyclictest0-21swapper/220:35:172
4074617993526,4cyclictest0-21swapper/223:20:192
4074620993428,3cyclictest0-21swapper/300:10:213
4074617993427,4cyclictest4183030-21cron00:25:002
4074617993426,4cyclictest0-21swapper/223:15:262
4074612993427,3cyclictest0-21swapper/121:20:211
4074612993426,4cyclictest4096024-21sh20:10:001
4074620993326,5cyclictest4137463-21kworker/u8:2+events_unbound22:13:003
4074620993326,3cyclictest0-21swapper/323:30:173
4074620993324,5cyclictest0-21swapper/300:00:153
4074617993325,4cyclictest0-21swapper/221:30:312
4074617993323,6cyclictest0-21swapper/219:55:012
4074617993322,6cyclictest0-21swapper/221:20:282
4074612993321,9cyclictest4109665-21cron20:50:001
4074620993226,3cyclictest0-21swapper/319:30:013
4074620993226,3cyclictest0-21swapper/319:30:003
4074620993225,5cyclictest4164516-21kworker/u8:1+events_unbound23:43:093
4074620993224,4cyclictest0-21swapper/319:15:013
4074617993225,3cyclictest0-21swapper/222:55:282
4074617993224,4cyclictest0-21swapper/219:20:312
4074617993224,4cyclictest0-21swapper/200:20:002
4074612993224,4cyclictest0-21swapper/123:10:171
4074607993225,4cyclictest0-21swapper/020:25:270
4074620993125,4cyclictest4104372-21kworker/u8:2+events_unbound20:40:433
4074620993124,4cyclictest4144436-21latency_hist22:30:003
4074620993123,5cyclictest4093910-21unixbench_singl20:00:253
4074620993123,4cyclictest0-21swapper/319:15:153
407462099312,18cyclictest4134972-21tr22:00:203
4074617993124,4cyclictest4092603-21cron20:00:012
4074617993123,4cyclictest4179769-21latency_hist00:15:002
4074617993122,6cyclictest4093807-21sort20:00:252
4074617993120,7cyclictest4149088-21grep22:40:282
4074612993123,4cyclictest0-21swapper/100:10:131
4074607993123,5cyclictest299-21systemd-logind19:17:450
4074607993121,7cyclictest4123337-21grep21:25:290
4074607993121,7cyclictest4123337-21grep21:25:290
4074607993121,6cyclictest0-21swapper/000:14:590
4074620993020,6cyclictest0-21swapper/321:00:283
4074617993024,3cyclictest0-21swapper/223:10:222
4074617993023,5cyclictest4133948-21kworker/u8:0+events_unbound22:03:002
4074617993022,4cyclictest0-21swapper/223:30:272
4074617993022,4cyclictest0-21swapper/221:40:262
4074617993019,7cyclictest4112650-21grep20:55:252
407461799301,5cyclictest131rcu_preempt23:45:132
4074617993015,5cyclictest4130306-21kworker/u8:0+events_unbound21:50:262
4074617993015,5cyclictest4130306-21kworker/u8:0+events_unbound21:50:262
407460799300,27cyclictest0-21swapper/021:20:170
4074620992922,5cyclictest4177170-21kworker/u8:0+events_unbound00:20:013
407462099291,6cyclictest131rcu_preempt21:20:163
4074612992922,3cyclictest0-21swapper/120:00:001
4074612992920,5cyclictest0-21swapper/122:10:301
4074607992921,4cyclictest0-21swapper/019:22:450
4074607992920,6cyclictest4100685-21grep20:20:290
4074607992918,7cyclictest4182592-21grep00:20:280
4074607992915,11cyclictest4074600-21cyclictest23:05:160
4074607992915,11cyclictest4074600-21cyclictest23:05:160
4074620992821,5cyclictest4133948-21kworker/u8:0+events_unbound22:08:013
4074620992820,4cyclictest0-21swapper/321:32:563
4074620992819,6cyclictest0-21swapper/300:25:263
407461799282,5cyclictest131rcu_preempt00:30:132
4074617992821,5cyclictest4164516-21kworker/u8:1+events_unbound23:54:032
4074617992817,6cyclictest4096036-21grep20:10:002
4074612992822,3cyclictest4181310-21kthreadd00:20:001
4074612992821,4cyclictest0-21swapper/121:10:271
4074612992821,4cyclictest0-21swapper/120:20:291
4074612992819,5cyclictest4137174-21grep22:05:281
4074607992822,4cyclictest0-21swapper/022:20:160
4074607992822,3cyclictest0-21swapper/019:40:010
4074607992821,3cyclictest0-21swapper/021:10:000
4074607992821,3cyclictest0-21swapper/021:10:000
4074607992821,3cyclictest0-21swapper/000:30:270
4074607992818,7cyclictest4108436-21grep20:45:170
407462099276,3cyclictest41156072ntp_states21:05:253
407462099276,3cyclictest41156072ntp_states21:05:253
4074620992720,5cyclictest4161126-21kworker/u8:0+events_unbound23:28:083
4074620992719,5cyclictest4160222-21fschecks_time23:15:163
4074620992719,5cyclictest0-21swapper/323:20:293
4074617992721,3cyclictest4144435-21kthreadd22:30:002
4074617992720,5cyclictest4083442-21kworker/u8:1+events_unbound19:46:212
4074617992719,5cyclictest0-21swapper/223:25:272
4074612992721,3cyclictest0-21swapper/119:35:011
4074612992721,3cyclictest0-21swapper/119:35:001
4074612992719,5cyclictest0-21swapper/122:00:011
4074612992719,5cyclictest0-21swapper/122:00:001
4074607992723,2cyclictest0-21swapper/022:35:150
4074607992721,4cyclictest0-21swapper/022:55:280
4074607992721,3cyclictest0-21swapper/020:35:270
4074607992720,4cyclictest0-21swapper/021:00:280
4074607992718,5cyclictest0-21swapper/023:30:000
4074607992711,12cyclictest215-21dbus-daemon22:02:590
4074620992618,5cyclictest0-21swapper/320:45:243
4074620992618,4cyclictest0-21swapper/321:55:323
4074620992618,4cyclictest0-21swapper/321:55:323
4074620992618,4cyclictest0-21swapper/320:05:253
4074620992616,6cyclictest0-21swapper/321:30:013
4074620992616,6cyclictest0-21swapper/321:30:003
4074617992620,4cyclictest4118343-21kworker/u8:1+events_unbound21:15:412
4074617992619,5cyclictest4149339-21kworker/u8:1+events_unbound22:47:472
4074617992615,8cyclictest4117575-21ps21:10:242
4074617992615,7cyclictest0-21swapper/221:50:012
407461799261,4cyclictest131rcu_preempt22:50:142
4074617992614,8cyclictest4077475-21cat19:15:172
4074612992618,6cyclictest4130588-21dpkg21:50:011
4074612992616,7cyclictest0-21swapper/123:45:171
4074612992615,7cyclictest4142332-21grep22:20:301
4074607992619,4cyclictest4151258-21latency_hist22:50:000
4074607992618,5cyclictest0-21swapper/022:00:000
4074607992618,5cyclictest0-21swapper/022:00:000
4074607992618,4cyclictest0-21swapper/020:02:480
4074620992517,4cyclictest0-21swapper/321:15:263
4074620992515,7cyclictest4141045-21basename22:20:013
4074620992515,7cyclictest4090283-21grep19:50:263
4074620992514,7cyclictest4083868-21latency_hist19:35:013
4074620992514,7cyclictest4083868-21latency_hist19:35:013
4074620992513,8cyclictest1-21systemd20:17:503
407461799257,4cyclictest131rcu_preempt00:35:112
4074617992518,4cyclictest4078264-21kworker/u8:0+events_unbound19:28:072
4074617992518,4cyclictest4078264-21kworker/u8:0+events_unbound19:28:072
4074617992517,5cyclictest0-21swapper/220:10:282
4074612992519,3cyclictest0-21swapper/121:05:261
4074612992519,3cyclictest0-21swapper/121:05:261
4074612992519,3cyclictest0-21swapper/121:00:241
4074612992518,4cyclictest0-21swapper/123:05:191
4074612992518,4cyclictest0-21swapper/123:05:191
4074607992519,3cyclictest0-21swapper/021:45:280
4074607992519,3cyclictest0-21swapper/000:40:010
4074607992518,4cyclictest4074600-21cyclictest21:45:000
4074607992518,4cyclictest0-21swapper/023:35:260
4074607992518,4cyclictest0-21swapper/021:00:000
4074607992515,7cyclictest4169544-21grep23:40:250
407460799251,20cyclictest4125449-21sh21:35:000
4074620992418,3cyclictest0-21swapper/320:30:173
4074620992417,5cyclictest4164516-21kworker/u8:1+events_unbound23:45:203
4074620992416,5cyclictest0-21swapper/321:45:003
4074620992416,4cyclictest4130575-21apt21:50:013
4074620992416,4cyclictest0-21swapper/300:35:243
4074620992412,8cyclictest391ktimers/323:00:133
4074617992418,3cyclictest0-21swapper/220:50:242
4074617992417,5cyclictest4177170-21kworker/u8:0+events_unbound00:06:592
4074617992417,4cyclictest4104133-21unixbench_singl20:30:282
4074617992417,4cyclictest4102862-21idleruntime-cro20:30:012
4074617992416,4cyclictest0-21swapper/223:05:002
4074617992414,7cyclictest4139301-21sh22:15:012
4074617992413,7cyclictest4075758-21grep19:10:282
4074612992416,4cyclictest4110915-21grep20:50:261
4074607992417,5cyclictest4164516-21kworker/u8:1+events_unbound23:53:150
4074607992414,7cyclictest121ktimers/019:25:150
4074607992414,7cyclictest121ktimers/019:25:140
407460799241,19cyclictest0-21swapper/020:10:550
407460799241,19cyclictest0-21swapper/019:46:470
407460799241,19cyclictest0-21swapper/000:25:090
4074620992317,3cyclictest0-21swapper/322:45:173
4074620992317,3cyclictest0-21swapper/322:40:013
4074620992316,5cyclictest4149339-21kworker/u8:1+events_unbound22:52:203
4074620992316,4cyclictest0-21swapper/319:40:303
4074620992316,3cyclictest0-21swapper/320:55:243
4074620992315,5cyclictest0-21swapper/323:55:243
4074617992317,3cyclictest0-21swapper/222:30:202
4074617992317,3cyclictest0-21swapper/200:25:242
4074617992315,5cyclictest311ktimers/223:10:002
4074617992315,5cyclictest311ktimers/223:10:002
4074617992314,5cyclictest0-21swapper/220:40:262
407461799231,11cyclictest0-21swapper/219:40:182
4074612992317,3cyclictest0-21swapper/122:05:011
4074612992315,4cyclictest0-21swapper/119:15:001
4074612992313,6cyclictest0-21swapper/100:30:261
407461299231,19cyclictest4151249-21sh22:50:001
4074607992317,3cyclictest0-21swapper/021:10:240
4074607992317,3cyclictest0-21swapper/019:15:010
4074607992316,4cyclictest4141022-21munin-plugin-st22:20:010
4074607992316,4cyclictest4090976-21latency_hist19:55:010
407460799231,19cyclictest0-21swapper/020:34:030
407460799231,18cyclictest0-21swapper/023:34:160
407460799231,18cyclictest0-21swapper/022:32:340
407460799231,18cyclictest0-21swapper/022:13:320
407460799231,18cyclictest0-21swapper/000:05:240
407460799230,19cyclictest0-21swapper/023:14:360
407460799230,19cyclictest0-21swapper/021:37:070
407460799230,19cyclictest0-21swapper/020:16:370
407460799230,19cyclictest0-21swapper/019:42:280
407460799230,19cyclictest0-21swapper/019:30:120
407460799230,19cyclictest0-21swapper/019:30:120
407460799230,19cyclictest0-21swapper/000:03:180
4074620992216,3cyclictest0-21swapper/321:14:013
4074620992215,4cyclictest0-21swapper/321:50:283
4074620992215,4cyclictest0-21swapper/321:50:273
4074620992212,6cyclictest4110890-21grep20:50:253
4074620992211,9cyclictest4102924-21sed20:30:013
4074617992215,5cyclictest4072080-21kworker/u8:2+events_unbound19:35:002
4074617992215,5cyclictest4072080-21kworker/u8:2+events_unbound19:34:592
4074617992214,4cyclictest0-21swapper/222:05:232
4074617992213,4cyclictest0-21swapper/223:35:252
4074617992212,6cyclictest0-21swapper/220:45:262
4074612992216,3cyclictest4080673-21fschecks_count19:25:181
4074612992216,3cyclictest4080673-21fschecks_count19:25:181
4074612992216,3cyclictest0-21swapper/123:15:171
4074612992216,3cyclictest0-21swapper/119:40:311
4074612992216,3cyclictest0-21swapper/100:25:231
4074612992215,4cyclictest4152952-21sh22:55:011
4074612992215,4cyclictest0-21swapper/121:25:281
4074612992215,4cyclictest0-21swapper/121:25:281
4074612992213,6cyclictest0-21swapper/123:20:291
4074612992212,6cyclictest0-21swapper/119:55:011
4074612992210,9cyclictest4164180-21cut23:25:261
4074607992217,3cyclictest13650irq/42-30be0000.ethernet23:00:180
4074607992217,3cyclictest13650irq/42-30be0000.ethernet20:05:170
4074607992215,3cyclictest0-21swapper/022:25:080
4074607992215,3cyclictest0-21swapper/020:44:230
4074607992214,5cyclictest0-21swapper/022:05:270
407460799221,19cyclictest0-21swapper/019:57:430
407460799220,18cyclictest0-21swapper/022:50:560
407460799220,18cyclictest0-21swapper/021:52:530
407460799220,18cyclictest0-21swapper/021:52:530
4074620992115,3cyclictest0-21swapper/323:35:193
4074620992114,4cyclictest4177905-21idleruntime-cro00:09:593
407461799211,5cyclictest131rcu_preempt20:15:162
4074612992115,3cyclictest0-21swapper/122:40:221
4074612992115,3cyclictest0-21swapper/121:30:301
4074612992115,3cyclictest0-21swapper/121:15:181
4074612992115,3cyclictest0-21swapper/119:45:221
4074612992111,7cyclictest4165679-21ntpq23:30:211
4074612992111,3cyclictest4103254-21fschecks_count20:30:191
4074620992014,4cyclictest391ktimers/322:30:193
4074620992011,7cyclictest4141543-21cat22:20:213
407461799201,10cyclictest4099808-21chrt20:20:202
4074612992013,5cyclictest231ktimers/122:30:141
4074612992012,4cyclictest4172972-21unixbench_multi23:50:271
4074612992011,6cyclictest4182241-21gzip00:20:251
4074612991913,4cyclictest231ktimers/120:25:241
4074612991912,5cyclictest231ktimers/120:55:141
4074612991912,5cyclictest231ktimers/120:15:171
4074612991912,5cyclictest231ktimers/120:10:151
4074612991711,4cyclictest231ktimers/100:05:261
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional