You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-11 - 05:12

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Phytec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackbslot5s.osadl.org (updated Sat Apr 11, 2026 00:44:51)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1003439995852,4cyclictest1084293-21kworker/u8:3+events_unbound23:32:480
1003450994941,5cyclictest1069215-21sh22:20:013
1003450994836,8cyclictest391ktimers/322:00:123
1003450994832,5cyclictest1081849-21kworker/u8:2+events_unbound23:17:443
1003442994840,5cyclictest1062396-21munin-plugin-st22:00:011
1003445994434,6cyclictest1061969-21grep21:55:252
1003450994334,7cyclictest391ktimers/320:10:133
1003450994334,5cyclictest1014199-21sh19:40:013
1003445994336,4cyclictest1045138-21ls21:10:012
1003450994215,5cyclictest131rcu_preempt22:25:123
1003450994132,5cyclictest1029315-21unixbench_multi20:20:243
1003450994129,8cyclictest1010378-21grep19:25:263
1003450994125,5cyclictest131rcu_preempt23:45:173
1003450994121,6cyclictest131rcu_preempt19:20:013
1003445994129,7cyclictest0-21swapper/223:30:012
1003442994131,7cyclictest1053665-21idleruntime-cro21:35:011
1003442994131,6cyclictest0-21swapper/121:35:151
1003442994130,6cyclictest1091387-21cron23:25:001
1003450994034,4cyclictest1053633-21kworker/u8:2+events_unbound21:57:313
1003450994027,8cyclictest1075550-21grep22:35:243
1003439994031,6cyclictest0-21swapper/021:55:000
1003439994029,7cyclictest1042961-21grep21:00:250
1003442993930,5cyclictest1029786-21auditctl20:25:011
1003442993926,9cyclictest1007373-21cron19:20:011
1003439993929,8cyclictest438-21cron23:25:000
1003445993829,4cyclictest1091387-21cron23:24:592
1003445993828,6cyclictest1073861-21grep22:30:252
1003439993830,6cyclictest1061971-21unixbench_singl21:55:240
1003450993731,4cyclictest1084293-21kworker/u8:3+events_unbound23:42:493
1003450993726,7cyclictest0-21swapper/321:50:003
1003445993728,6cyclictest1027804-21kworker/u8:0+events_unbound20:22:122
1003439993728,6cyclictest1108440-21unixbench_singl00:10:260
1003439993728,6cyclictest1108440-21unixbench_singl00:10:260
1003445993626,6cyclictest1063694-21unixbench_singl22:00:262
1003439993630,3cyclictest1010801-21kthreadd19:30:010
1003450993525,6cyclictest0-21swapper/322:59:593
1003450993524,7cyclictest0-21swapper/322:55:003
1003450993524,7cyclictest0-21swapper/322:45:003
1003445993528,4cyclictest1021051-21idleruntime-cro20:00:002
1003445993527,4cyclictest0-21swapper/223:40:142
1003445993524,8cyclictest1024438-21cron20:10:002
1003445993524,8cyclictest1024438-21cron20:09:592
1003442993526,6cyclictest1034894-21grep20:40:001
1003442993513,5cyclictest131rcu_preempt19:10:121
100344299351,15cyclictest0-21swapper/120:05:131
100344299351,15cyclictest0-21swapper/120:05:131
1003439993529,4cyclictest1009098-21auditctl19:25:010
1003439993523,9cyclictest121ktimers/020:00:130
1003439993523,9cyclictest121ktimers/020:00:120
1003439993519,13cyclictest0-21swapper/020:25:000
1003450993428,4cyclictest1072422-21kworker/u8:3+events_unbound22:32:383
1003450993426,6cyclictest1115363-21kworker/u8:3+events_unbound00:33:423
1003450993425,5cyclictest0-21swapper/323:25:253
1003445993426,4cyclictest0-21swapper/220:35:002
1003442993427,4cyclictest1063698-21unixbench_singl22:00:261
1003439993427,4cyclictest0-21swapper/022:50:230
1003450993322,6cyclictest0-21swapper/321:15:253
1003450993322,6cyclictest0-21swapper/300:05:253
1003450993320,8cyclictest391ktimers/319:10:113
1003450993319,10cyclictest1101822-21debian-sa123:55:003
1003450993312,12cyclictest40-21ksoftirqd/321:20:173
1003450993310,11cyclictest40-21ksoftirqd/320:30:213
1003445993327,4cyclictest1068580-21kworker/u8:1+events_unbound22:57:402
1003445993325,4cyclictest0-21swapper/220:00:172
1003445993325,4cyclictest0-21swapper/220:00:172
1003445993324,6cyclictest1079452-21idleruntime-cro22:50:002
1003442993325,4cyclictest1076033-21latency_hist22:40:001
100344299332,4cyclictest131rcu_preempt21:50:131
1003439993324,6cyclictest1073864-21unixbench_multi22:30:260
1003439993323,6cyclictest0-21swapper/023:17:440
1003450993225,5cyclictest1108494-21kworker/u8:1+events_unbound00:12:413
1003450993225,5cyclictest1108494-21kworker/u8:1+events_unbound00:12:413
1003450993225,5cyclictest1094777-21kworker/u8:1+events_unbound23:32:503
1003450993223,4cyclictest0-21swapper/300:15:153
1003450993219,4cyclictest131rcu_preempt21:37:053
1003445993227,3cyclictest1051798-21kworker/u8:1+events_unbound21:32:272
1003445993224,4cyclictest0-21swapper/219:25:162
1003445993222,5cyclictest0-21swapper/222:05:232
100344299323,6cyclictest131rcu_preempt22:05:111
1003442993224,5cyclictest1036606-21auditctl20:44:591
1003442993224,4cyclictest0-21swapper/100:15:141
1003442993224,4cyclictest0-21swapper/100:05:001
1003442993222,6cyclictest0-21swapper/123:05:241
1003442993222,6cyclictest0-21swapper/123:05:231
1003439993222,7cyclictest1098422-21sh23:45:000
1003439993222,7cyclictest0-21swapper/019:40:170
100345099317,14cyclictest40-21ksoftirqd/319:45:083
100345099315,8cyclictest40-21ksoftirqd/321:50:253
1003450993125,4cyclictest1081849-21kworker/u8:2+events_unbound23:02:403
1003450993123,4cyclictest0-21swapper/323:35:253
1003450993117,12cyclictest391ktimers/323:10:133
1003450993117,12cyclictest391ktimers/323:10:123
1003450993110,14cyclictest40-21ksoftirqd/319:30:233
1003445993122,4cyclictest0-21swapper/222:40:002
1003445993120,7cyclictest1041714-21grep20:59:592
1003442993124,5cyclictest1053633-21kworker/u8:2+events_unbound21:45:161
1003442993123,4cyclictest0-21swapper/123:15:241
1003442993123,4cyclictest0-21swapper/119:35:011
1003442993121,6cyclictest0-21swapper/121:20:011
1003442993121,6cyclictest0-21swapper/120:20:001
1003442993120,7cyclictest0-21swapper/123:35:251
1003439993125,3cyclictest1019321-21auditctl19:55:010
1003439993125,3cyclictest0-21swapper/020:20:000
1003439993123,5cyclictest0-21swapper/000:24:590
1003439993123,4cyclictest0-21swapper/020:55:000
1003439993121,6cyclictest0-21swapper/021:00:000
1003450993024,4cyclictest1025900-21kworker/u8:3+events_unbound20:42:173
1003450993020,7cyclictest1015446-21grep19:40:253
1003450993018,8cyclictest0-21swapper/300:00:213
1003450993010,6cyclictest131rcu_preempt21:05:253
1003445993023,4cyclictest0-21swapper/221:50:262
1003442993020,7cyclictest0-21swapper/123:59:591
1003442993020,6cyclictest1073074-21fschecks_time22:30:161
1003442993020,6cyclictest1013782-21unixbench_singl19:35:261
1003442993018,8cyclictest0-21swapper/120:05:001
1003442993018,8cyclictest0-21swapper/120:05:001
1003442993018,7cyclictest0-21swapper/119:55:241
1003439993024,3cyclictest0-21swapper/022:25:000
1003439993022,4cyclictest0-21swapper/021:25:010
100343999301,2cyclictest0-21swapper/019:30:100
100345099299,11cyclictest40-21ksoftirqd/322:05:163
100345099299,11cyclictest40-21ksoftirqd/320:50:193
100345099298,5cyclictest0-21swapper/321:11:503
100345099298,12cyclictest131rcu_preempt20:25:253
100345099298,11cyclictest0-21swapper/322:20:413
1003450992918,6cyclictest0-21swapper/320:45:253
1003450992918,6cyclictest0-21swapper/320:45:243
1003450992910,12cyclictest40-21ksoftirqd/322:45:263
1003450992910,12cyclictest40-21ksoftirqd/321:25:193
1003445992923,3cyclictest0-21swapper/219:20:012
1003445992922,4cyclictest0-21swapper/219:30:242
1003445992922,3cyclictest0-21swapper/220:45:242
1003445992922,3cyclictest0-21swapper/220:45:242
1003445992922,3cyclictest0-21swapper/220:20:012
1003445992916,11cyclictest1003430-21cyclictest23:10:132
1003445992916,11cyclictest1003430-21cyclictest23:10:132
100344299291,4cyclictest131rcu_preempt19:40:131
1003439992924,3cyclictest1017625-21kthreadd19:50:010
1003439992921,6cyclictest1022612-21kworker/u8:2+events_unbound20:07:100
1003439992921,6cyclictest1022612-21kworker/u8:2+events_unbound20:07:100
1003439992919,6cyclictest0-21swapper/020:49:590
1003439992919,6cyclictest0-21swapper/020:49:590
100345099289,11cyclictest0-21swapper/300:35:333
100345099289,10cyclictest40-21ksoftirqd/321:30:273
100345099287,12cyclictest40-21ksoftirqd/320:05:223
100345099287,12cyclictest40-21ksoftirqd/320:05:223
100345099281,7cyclictest0-21swapper/321:00:123
1003450992815,5cyclictest131rcu_preempt20:55:203
1003450992811,3cyclictest131rcu_preempt19:56:443
1003445992822,3cyclictest0-21swapper/223:40:002
1003445992820,4cyclictest0-21swapper/220:52:172
1003445992819,5cyclictest0-21swapper/200:15:252
1003445992818,6cyclictest1-21systemd21:12:202
1003445992817,7cyclictest1103565-21basename00:00:002
100344299284,5cyclictest131rcu_preempt00:20:111
1003442992819,5cyclictest0-21swapper/121:00:001
1003442992817,7cyclictest0-21swapper/123:05:001
1003439992823,3cyclictest1107161-21latency_hist00:10:000
1003439992819,5cyclictest0-21swapper/021:10:230
1003439992818,6cyclictest0-21swapper/023:00:000
100345099278,11cyclictest40-21ksoftirqd/323:05:193
100345099278,11cyclictest40-21ksoftirqd/323:05:193
100345099277,11cyclictest40-21ksoftirqd/300:00:013
100345099276,12cyclictest131rcu_preempt20:00:263
100345099276,12cyclictest131rcu_preempt20:00:253
1003450992720,4cyclictest1008623-21grep19:20:243
1003450992713,5cyclictest1087669-21kworker/u8:0+events_unbound23:23:583
1003445992721,3cyclictest0-21swapper/200:40:002
1003445992717,6cyclictest0-21swapper/222:25:012
1003442992719,4cyclictest0-21swapper/100:15:001
1003442992719,4cyclictest0-21swapper/100:15:001
1003439992720,3cyclictest0-21swapper/000:35:250
1003439992719,5cyclictest11-21ksoftirqd/020:10:130
1003439992719,5cyclictest0-21swapper/020:40:260
100343999271,22cyclictest1087964-21cron23:15:000
100343999271,22cyclictest1087964-21cron23:14:590
100345099267,12cyclictest40-21ksoftirqd/319:50:053
100344599265,3cyclictest11114772processes00:20:232
1003445992621,3cyclictest1076974-21/usr/sbin/munin22:40:232
1003445992617,4cyclictest0-21swapper/220:12:102
1003442992619,4cyclictest1043279-21kworker/u8:1+events_unbound21:20:231
1003442992617,6cyclictest1043022-21grep21:00:241
1003442992617,5cyclictest1084293-21kworker/u8:3+events_unbound23:30:011
1003442992617,5cyclictest0-21swapper/122:25:171
1003442992616,7cyclictest1031072-21grep20:25:251
100343999268,15cyclictest0-21swapper/021:20:010
1003439992620,3cyclictest1113982-21kthreadd00:29:590
100343999261,9cyclictest1103111-21unixbench_singl23:55:240
1003439992618,5cyclictest0-21swapper/023:39:590
1003439992618,5cyclictest0-21swapper/020:25:250
1003439992616,6cyclictest0-21swapper/022:40:250
100345099257,4cyclictest0-21swapper/300:26:233
1003450992517,4cyclictest0-21swapper/300:20:253
1003450992515,6cyclictest0-21swapper/320:35:253
1003450992515,5cyclictest1026541-21fschecks_count20:15:163
1003445992519,3cyclictest0-21swapper/222:30:012
1003445992518,3cyclictest0-21swapper/200:25:162
1003445992517,5cyclictest0-21swapper/222:15:172
1003445992515,7cyclictest1083622-21ntpq23:00:202
1003442992518,5cyclictest1113609-21kworker/u8:1+events_unbound00:30:401
1003442992516,4cyclictest0-21swapper/121:05:161
1003439992518,4cyclictest13550irq/42-30be0000.ethernet19:20:010
1003439992516,6cyclictest0-21swapper/000:20:000
1003450992416,6cyclictest1053633-21kworker/u8:2+events_unbound22:10:093
1003445992418,3cyclictest0-21swapper/222:55:002
1003445992418,3cyclictest0-21swapper/220:35:112
1003445992417,3cyclictest0-21swapper/221:20:252
1003445992416,6cyclictest1030170-21fschecks_count20:25:162
1003445992416,5cyclictest0-21swapper/221:40:252
1003445992416,5cyclictest0-21swapper/221:40:252
1003445992416,4cyclictest0-21swapper/221:00:252
1003445992415,6cyclictest0-21swapper/221:40:012
1003445992415,5cyclictest0-21swapper/200:00:172
1003445992414,7cyclictest1005177-21date19:15:022
100344599241,3cyclictest131rcu_preempt22:10:242
1003445992413,7cyclictest0-21swapper/221:25:232
1003445992412,8cyclictest0-21swapper/219:20:142
1003442992418,4cyclictest1105109-21kworker/u8:0+events_unbound00:09:281
1003442992417,5cyclictest1045056-21kworker/u8:3+events_unbound21:12:211
1003442992415,6cyclictest1116457-21grep00:35:211
1003439992418,3cyclictest0-21swapper/022:00:260
1003439992418,3cyclictest0-21swapper/000:00:260
1003439992417,4cyclictest0-21swapper/021:25:260
1003439992417,3cyclictest0-21swapper/023:05:080
1003439992417,3cyclictest0-21swapper/023:05:080
1003439992417,3cyclictest0-21swapper/022:20:010
1003439992416,5cyclictest0-21swapper/022:50:000
1003439992416,5cyclictest0-21swapper/019:10:150
1003439992415,6cyclictest1052180-21taskset21:30:070
100343999241,3cyclictest1054461-21ntp_states21:35:200
100343999241,20cyclictest1083151-21egrep23:00:140
100343999241,19cyclictest0-21swapper/022:25:050
100343999241,19cyclictest0-21swapper/019:58:230
100343999241,19cyclictest0-21swapper/000:32:240
1003445992317,3cyclictest0-21swapper/223:45:232
1003445992317,3cyclictest0-21swapper/221:45:242
1003445992314,5cyclictest1108457-21grep00:10:262
1003445992314,5cyclictest1108457-21grep00:10:252
1003445992314,5cyclictest1017158-21unixbench_multi19:45:252
1003442992317,3cyclictest0-21swapper/123:55:011
1003442992317,3cyclictest0-21swapper/120:50:131
1003442992316,5cyclictest1081849-21kworker/u8:2+events_unbound23:30:041
1003442992316,5cyclictest1053633-21kworker/u8:2+events_unbound22:17:501
1003442992315,5cyclictest0-21swapper/119:25:231
1003442992315,4cyclictest1100119-21cron23:50:001
1003442992315,4cyclictest0-21swapper/122:20:191
100344299231,4cyclictest1018479-21wc19:50:231
1003442992314,6cyclictest231ktimers/121:40:041
1003442992314,6cyclictest231ktimers/121:40:041
1003442992314,6cyclictest0-21swapper/122:40:171
100344299231,11cyclictest1051472-21grep21:25:241
1003439992316,4cyclictest1064866-21ntpq22:05:190
1003439992316,3cyclictest0-21swapper/019:36:020
1003439992314,6cyclictest0-21swapper/020:35:010
1003439992313,6cyclictest0-21swapper/022:10:240
100343999231,20cyclictest0-21swapper/022:37:510
100343999231,18cyclictest0-21swapper/021:05:050
100344599226,3cyclictest1015717-21sshd19:42:412
1003445992216,3cyclictest0-21swapper/223:05:242
1003445992216,3cyclictest0-21swapper/223:05:242
1003445992216,3cyclictest0-21swapper/200:30:222
1003445992215,4cyclictest1106419-21mailstats00:05:252
1003445992215,4cyclictest1048096-21unixbench_singl21:15:262
1003445992215,3cyclictest0-21swapper/223:50:252
100344299226,3cyclictest131rcu_preempt22:55:231
1003442992216,4cyclictest1003430-21cyclictest00:25:141
1003442992215,4cyclictest0-21swapper/122:10:171
1003442992214,6cyclictest231ktimers/120:30:231
1003442992214,3cyclictest0-21swapper/120:10:131
1003439992216,3cyclictest0-21swapper/023:45:200
1003439992215,3cyclictest0-21swapper/023:25:310
100343999220,20cyclictest0-21swapper/021:47:070
1003445992115,3cyclictest0-21swapper/220:40:182
1003445992114,5cyclictest311ktimers/223:15:112
1003442992115,4cyclictest1081849-21kworker/u8:2+events_unbound23:10:231
1003442992115,4cyclictest1081849-21kworker/u8:2+events_unbound23:10:231
1003442992115,3cyclictest0-21swapper/119:45:221
1003442992114,3cyclictest0-21swapper/122:45:221
1003442992110,8cyclictest1007837-21grep19:20:151
1003439992116,3cyclictest13550irq/42-30be0000.ethernet20:40:010
1003439992114,4cyclictest121ktimers/021:40:250
1003439992114,4cyclictest121ktimers/021:40:250
1003445992015,3cyclictest1093616-21cpuspeed23:30:142
1003442992012,4cyclictest0-21swapper/123:40:241
1003442991912,5cyclictest231ktimers/120:45:121
1003442991912,5cyclictest231ktimers/120:45:121
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional