You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-19 - 05:44

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Phytec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackbslot5s.osadl.org (updated Sun Jul 19, 2026 00:44:43)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
452640995728,6cyclictest0-21swapper/300:25:273
452627995244,4cyclictest505609-21idleruntime-cro21:40:020
452636995037,10cyclictest311ktimers/219:10:132
452627994939,6cyclictest501566-21grep21:25:270
452631994536,6cyclictest498365-21awk21:20:011
452640994430,11cyclictest391ktimers/322:40:123
452640994134,4cyclictest536942-21munin-run23:10:003
452627994130,6cyclictest539859-21chrt23:15:270
452640994033,4cyclictest501982-21cron21:30:003
452627994031,6cyclictest519345-21kworker/u8:0+events_unbound22:22:590
452631993931,4cyclictest493029-21sh21:05:011
452627993928,7cyclictest0-21swapper/000:20:000
452640993831,4cyclictest477461-21munin-run20:20:013
452640993828,6cyclictest0-21swapper/319:45:013
452636993830,3cyclictest0-21swapper/220:52:382
452631993831,4cyclictest526488-21munin-plugin-st22:40:001
452627993829,4cyclictest0-21swapper/019:45:010
452636993729,5cyclictest472347-21sh20:05:012
452627993730,4cyclictest526509-21sendmail22:40:000
452640993626,7cyclictest475319-21grep20:10:283
452640993626,6cyclictest0-21swapper/322:50:173
452640993626,6cyclictest0-21swapper/322:50:173
45262799365,6cyclictest131rcu_preempt21:00:120
452640993528,3cyclictest0-21swapper/319:55:183
452640993525,7cyclictest491322-21cut21:00:003
452640993525,7cyclictest0-21swapper/300:20:263
452640993524,7cyclictest0-21swapper/323:50:173
452636993528,4cyclictest0-21swapper/200:30:002
452631993524,8cyclictest552703-21sh23:55:001
452627993523,8cyclictest552239-21grep23:50:270
45262799350,33cyclictest0-21swapper/000:35:120
452640993425,4cyclictest0-21swapper/323:55:263
452640993423,7cyclictest0-21swapper/321:40:023
452636993426,4cyclictest0-21swapper/220:20:002
452636993425,6cyclictest496883-21apt-get21:15:152
452636993424,7cyclictest486197-21cron20:45:002
452636993410,6cyclictest32-21ksoftirqd/220:50:012
452640993322,8cyclictest498374-21sendmail21:20:023
452636993326,4cyclictest465263-21runrttasks19:45:012
452636993323,6cyclictest0-21swapper/222:50:262
452636993323,6cyclictest0-21swapper/222:50:262
45263699332,28cyclictest557152-21sed00:05:252
452631993326,4cyclictest0-21swapper/119:35:241
452631993325,4cyclictest0-21swapper/119:45:271
452631993323,6cyclictest0-21swapper/119:40:261
452631993322,7cyclictest0-21swapper/119:55:001
452627993326,5cyclictest541778-21kworker/u8:1+events_unbound23:22:420
452627993321,8cyclictest121ktimers/022:05:110
452640993223,6cyclictest0-21swapper/323:00:273
452640993223,4cyclictest0-21swapper/323:10:153
452640993221,8cyclictest506255-21tune2fs21:40:143
452636993225,3cyclictest0-21swapper/221:55:262
452636993223,5cyclictest0-21swapper/221:00:002
452631993225,4cyclictest0-21swapper/121:55:261
452631993224,5cyclictest492983-21kworker/u8:2+events_unbound21:27:481
452631993221,7cyclictest490888-21grep20:55:261
452631993221,7cyclictest0-21swapper/122:20:001
452627993223,5cyclictest473596-21grep20:05:250
452627993222,6cyclictest0-21swapper/000:05:160
452627993221,6cyclictest0-21swapper/020:35:000
452640993123,5cyclictest474043-21cron20:10:013
452640993122,6cyclictest0-21swapper/321:00:253
452640993122,4cyclictest529940-21latency_hist22:50:003
452640993120,7cyclictest559054-21grep00:10:253
452640993120,7cyclictest0-21swapper/320:25:163
452636993124,4cyclictest0-21swapper/220:10:282
452636993121,7cyclictest0-21swapper/200:40:002
452636993117,10cyclictest493815-21/usr/sbin/munin21:05:182
452636993113,9cyclictest452618-21cyclictest21:34:512
452631993124,4cyclictest0-21swapper/120:10:281
452631993123,4cyclictest0-21swapper/100:00:291
452631993122,6cyclictest533069-21grep22:55:261
452631993122,6cyclictest0-21swapper/120:35:261
452640993022,4cyclictest0-21swapper/322:20:283
452640993020,6cyclictest0-21swapper/320:35:263
452640993020,6cyclictest0-21swapper/319:10:163
45263699309,15cyclictest0-21swapper/200:30:122
452636993023,4cyclictest516269-21munin-plugin-st22:10:012
452636993023,3cyclictest0-21swapper/223:10:252
452636993021,3cyclictest131rcu_preempt00:01:162
452636993020,7cyclictest520952-21grep22:20:282
452636993020,6cyclictest0-21swapper/221:10:262
452636993020,6cyclictest0-21swapper/220:30:152
452636993019,7cyclictest456080-21grep19:15:262
452636993015,9cyclictest131rcu_preempt22:59:452
452631993024,4cyclictest562962-21munin-plugin-st00:25:001
452631993023,4cyclictest0-21swapper/120:40:171
452627993022,4cyclictest0-21swapper/023:05:010
452627993021,6cyclictest457874-21grep19:20:270
452627993020,6cyclictest0-21swapper/021:20:250
452627993019,7cyclictest498344-21cron21:20:000
452627993018,8cyclictest543518-21grep23:25:260
452640992923,3cyclictest509230-21kthreadd21:50:003
452640992921,5cyclictest0-21swapper/320:50:263
452640992918,7cyclictest512633-21sh22:00:003
452636992923,4cyclictest311ktimers/223:48:192
452631992922,4cyclictest0-21swapper/121:40:221
452631992922,4cyclictest0-21swapper/121:40:011
452631992921,4cyclictest0-21swapper/122:05:151
45262799292,5cyclictest131rcu_preempt23:35:140
452627992923,4cyclictest0-21swapper/021:55:130
452627992919,4cyclictest0-21swapper/023:00:010
452627992910,16cyclictest477518-21apt-key20:20:020
452640992822,3cyclictest0-21swapper/323:20:273
452640992820,4cyclictest0-21swapper/321:10:273
452640992820,3cyclictest0-21swapper/300:05:253
452640992818,6cyclictest0-21swapper/319:20:173
452640992816,9cyclictest503685-21audit_send_reply21:35:003
45263699289,5cyclictest32-21ksoftirqd/223:40:012
45263699288,6cyclictest0-21swapper/219:35:152
452636992820,4cyclictest0-21swapper/222:15:242
452636992816,6cyclictest131rcu_preempt20:37:072
452636992814,10cyclictest204-21dbus-daemon23:18:092
452636992813,8cyclictest131rcu_preempt20:26:392
452631992820,4cyclictest0-21swapper/122:30:251
45262799289,3cyclictest509723-21if_err_eth021:50:170
452627992822,4cyclictest492983-21kworker/u8:2+events_unbound21:12:470
452627992822,4cyclictest452618-21cyclictest00:20:200
452627992819,6cyclictest465654-21wc19:45:160
45262799281,5cyclictest131rcu_preempt22:15:100
452640992720,4cyclictest0-21swapper/322:02:553
452640992719,4cyclictest0-21swapper/320:00:263
452640992717,7cyclictest391ktimers/323:35:153
452640992717,6cyclictest0-21swapper/322:55:263
452636992718,5cyclictest473571-21grep20:05:252
452636992712,9cyclictest131rcu_preempt21:51:302
452631992719,5cyclictest0-21swapper/119:55:271
452631992717,6cyclictest454248-21cron19:15:021
452627992722,3cyclictest0-21swapper/023:55:130
452627992721,4cyclictest480726-21kworker/u8:0+events_unbound20:27:310
452627992721,3cyclictest549270-21latency_hist23:45:000
452627992720,4cyclictest484192-21kworker/u8:0+events_unbound20:47:350
452627992720,3cyclictest0-21swapper/023:45:250
452627992719,3cyclictest0-21swapper/019:55:000
452627992718,5cyclictest0-21swapper/019:35:190
452627992716,6cyclictest459570-21grep19:25:280
452640992618,4cyclictest0-21swapper/323:20:003
452640992617,7cyclictest391ktimers/322:25:113
452640992616,7cyclictest550596-21grep23:45:263
452636992619,4cyclictest0-21swapper/223:20:172
452636992617,3cyclictest131rcu_preempt21:01:322
452636992613,10cyclictest504241-21/usr/sbin/munin21:35:152
452636992611,8cyclictest131rcu_preempt19:24:352
452631992620,3cyclictest0-21swapper/123:20:271
452631992620,3cyclictest0-21swapper/122:45:191
452631992618,5cyclictest492983-21kworker/u8:2+events_unbound21:12:441
452631992618,5cyclictest0-21swapper/123:10:241
452631992618,4cyclictest0-21swapper/121:45:191
452631992617,4cyclictest0-21swapper/120:00:161
452631992616,7cyclictest568260-21sh00:40:001
45262799267,3cyclictest527127-21cat22:40:180
452627992617,5cyclictest559106-21grep00:10:250
452627992616,7cyclictest121ktimers/022:50:130
452627992616,7cyclictest121ktimers/022:50:130
452627992612,9cyclictest204-21dbus-daemon20:22:290
452640992519,3cyclictest463402-21sendmail19:40:003
452640992518,3cyclictest0-21swapper/323:30:183
452640992518,3cyclictest0-21swapper/319:30:263
452640992517,5cyclictest0-21swapper/300:00:303
452640992516,6cyclictest0-21swapper/319:50:273
452640992515,6cyclictest566353-21auditctl00:35:003
45263699259,9cyclictest131rcu_preempt22:12:162
45263699259,6cyclictest131rcu_preempt22:32:172
45263699258,8cyclictest131rcu_preempt21:28:052
45263699258,10cyclictest131rcu_preempt23:27:012
452636992519,3cyclictest0-21swapper/222:05:002
452636992516,7cyclictest552937-21/usr/sbin/munin23:55:172
452636992516,6cyclictest561237-21auditctl00:20:002
452636992515,7cyclictest544971-21/usr/sbin/munin23:30:252
452636992515,3cyclictest131rcu_preempt19:30:172
452631992518,4cyclictest0-21swapper/120:20:161
452631992517,4cyclictest0-21swapper/121:35:001
452631992514,8cyclictest547389-21ls23:40:001
452631992514,7cyclictest0-21swapper/100:35:001
452627992519,4cyclictest458117-21kworker/u8:2+events_unbound19:30:160
452627992516,5cyclictest121ktimers/021:40:150
452627992515,6cyclictest545266-21grep23:30:260
452640992418,3cyclictest0-21swapper/322:05:233
452640992418,3cyclictest0-21swapper/300:15:243
452640992416,4cyclictest438-21cron23:45:003
452640992415,7cyclictest485458-21mailstats20:40:253
452640992415,5cyclictest0-21swapper/319:45:183
452640992414,7cyclictest518016-21sed22:15:013
45263699242,12cyclictest0-21swapper/200:13:512
452636992415,6cyclictest311ktimers/219:52:572
452636992414,7cyclictest533902-21/usr/sbin/munin23:00:162
452636992414,7cyclictest508099-21/usr/sbin/munin21:45:212
452636992414,3cyclictest131rcu_preempt22:35:232
452636992412,9cyclictest522994-21cron22:29:002
45263699241,13cyclictest0-21swapper/219:49:022
45263699241,13cyclictest0-21swapper/200:24:152
452636992410,9cyclictest131rcu_preempt23:41:232
45263699240,12cyclictest0-21swapper/222:42:232
452631992417,5cyclictest231ktimers/123:01:501
452631992417,4cyclictest0-21swapper/123:30:171
452631992417,3cyclictest0-21swapper/119:15:171
452631992416,5cyclictest0-21swapper/123:05:261
45262799244,14cyclictest13550irq/42-30be0000.ethernet19:15:140
452627992419,3cyclictest13550irq/42-30be0000.ethernet23:10:170
452627992418,3cyclictest0-21swapper/020:10:230
452627992417,5cyclictest503371-21taskset21:31:230
452627992417,4cyclictest13850irq/36-mmc121:00:000
452627992417,3cyclictest0-21swapper/019:15:010
452627992416,5cyclictest121ktimers/023:05:260
452627992416,4cyclictest471937-21head20:00:260
452627992416,4cyclictest0-21swapper/020:40:240
452627992415,6cyclictest564245-21grep00:25:270
452627992415,5cyclictest0-21swapper/021:45:190
45262799241,4cyclictest517062-21ntp_states22:10:210
452627992414,6cyclictest0-21swapper/022:35:010
45262799241,19cyclictest0-21swapper/021:05:520
45262799241,19cyclictest0-21swapper/000:34:590
452640992314,6cyclictest525157-21fschecks_count22:35:163
452640992313,6cyclictest0-21swapper/320:20:253
45263699236,13cyclictest506144-21/usr/sbin/munin21:40:112
45263699234,2cyclictest0-21swapper/219:55:152
452636992317,3cyclictest0-21swapper/223:50:172
452636992313,7cyclictest478368-21/usr/sbin/munin20:20:202
452636992312,8cyclictest535842-21/usr/sbin/munin23:05:192
45263699231,13cyclictest0-21swapper/219:25:112
452636992310,10cyclictest499262-21/usr/sbin/munin21:20:202
452631992317,3cyclictest0-21swapper/122:40:211
452631992317,3cyclictest0-21swapper/119:30:241
452631992316,4cyclictest0-21swapper/121:20:251
452631992316,3cyclictest0-21swapper/100:25:211
452631992315,6cyclictest231ktimers/123:45:041
452631992314,6cyclictest473570-21grep20:05:261
452631992314,6cyclictest0-21swapper/119:25:001
452627992315,3cyclictest0-21swapper/022:00:260
45262799231,18cyclictest0-21swapper/020:52:290
45262799230,19cyclictest0-21swapper/022:25:570
45262799230,19cyclictest0-21swapper/019:57:460
452640992216,3cyclictest0-21swapper/320:45:243
452640992216,3cyclictest0-21swapper/320:30:233
452640992215,5cyclictest391ktimers/323:25:133
452640992215,4cyclictest0-21swapper/319:25:293
452640992214,5cyclictest391ktimers/322:15:123
452640992214,5cyclictest0-21swapper/322:30:193
452640992214,4cyclictest0-21swapper/321:50:163
452640992214,4cyclictest0-21swapper/321:05:253
452631992216,3cyclictest0-21swapper/123:40:161
452631992215,4cyclictest521708-21cstates22:25:141
452631992215,4cyclictest520978-21grep22:20:291
452631992214,5cyclictest0-21swapper/119:25:281
452631992214,4cyclictest0-21swapper/123:55:161
452631992213,6cyclictest477734-21ls20:20:011
452627992216,3cyclictest13550irq/42-30be0000.ethernet00:00:250
45262799220,20cyclictest0-21swapper/020:39:240
452640992111,5cyclictest0-21swapper/321:25:003
452631992116,3cyclictest0-21swapper/121:05:011
452631992115,3cyclictest0-21swapper/100:20:011
452631992114,4cyclictest0-21swapper/100:10:191
452631992113,5cyclictest0-21swapper/123:20:021
452640992014,3cyclictest0-21swapper/319:15:153
452631992014,3cyclictest0-21swapper/120:30:211
452631992013,5cyclictest231ktimers/120:50:251
452631992012,5cyclictest0-21swapper/122:05:011
452631992012,4cyclictest0-21swapper/100:05:251
452631992010,8cyclictest480389-21awk20:25:241
452631991811,5cyclictest231ktimers/122:10:121
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional