You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-20 - 09:57

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Phytec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackbslot5s.osadl.org (updated Wed May 20, 2026 00:44:47)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
9341994834,11cyclictest121ktimers/020:05:130
9346994739,5cyclictest26927-21munin-run20:00:011
9346994634,9cyclictest231ktimers/122:30:121
9341994633,10cyclictest121ktimers/022:20:120
9346994438,4cyclictest30177-21kworker/u8:3+events_unbound20:50:471
9355994336,4cyclictest33984-21sendmail20:20:003
9350994336,4cyclictest58067-21grep21:30:002
9350994332,7cyclictest311ktimers/222:40:122
9341994235,4cyclictest75330-21sendmail22:19:590
9341994232,6cyclictest0-21swapper/019:35:000
9355994132,5cyclictest115198-21idleruntime-cro00:14:593
9355994132,5cyclictest115198-21idleruntime-cro00:14:593
9346994132,4cyclictest0-21swapper/123:20:001
9346994131,5cyclictest0-21swapper/100:16:221
9355993931,4cyclictest116915-21sendmail00:20:003
9355993829,6cyclictest85304-21unixbench_multi22:45:253
9355993827,7cyclictest0-21swapper/320:00:003
9350993832,4cyclictest30177-21kworker/u8:3+events_unbound20:30:432
9350993831,4cyclictest20105-21cron19:40:002
9350993831,3cyclictest0-21swapper/221:10:012
9346993832,4cyclictest33726-21kworker/u8:0+events_unbound20:45:471
9346993831,4cyclictest52741-21munin-plugin-st21:15:001
9346993828,7cyclictest35676-21sh20:25:011
9341993825,9cyclictest121ktimers/021:15:140
9341993825,9cyclictest121ktimers/021:15:140
9355993730,4cyclictest84067-21auditctl22:45:013
9355993725,8cyclictest18394-21sh19:35:003
9346993728,4cyclictest0-21swapper/121:50:251
9346993724,5cyclictest131rcu_preempt00:39:301
9341993716,9cyclictest11-21ksoftirqd/019:20:100
9346993629,4cyclictest21815-21sh19:45:001
9346993627,4cyclictest0-21swapper/100:30:001
9346993624,7cyclictest0-21swapper/120:40:001
9346993617,5cyclictest131rcu_preempt22:10:011
9346993617,5cyclictest131rcu_preempt22:10:011
9341993628,4cyclictest0-21swapper/000:36:260
9341993626,6cyclictest106005-21grep23:45:310
9350993527,4cyclictest0-21swapper/222:40:002
9350993525,6cyclictest0-21swapper/223:40:012
9346993525,6cyclictest0-21swapper/123:30:311
9346993523,3cyclictest131rcu_preempt23:50:211
9346993518,4cyclictest131rcu_preempt22:59:181
9346993517,8cyclictest62833-21ls21:40:251
9346993513,5cyclictest131rcu_preempt19:20:181
9341993526,6cyclictest71453-21unixbench_multi22:05:270
9341993526,6cyclictest71453-21unixbench_multi22:05:260
9355993427,4cyclictest47610-21sendmail21:00:003
9355993426,4cyclictest0-21swapper/319:20:153
935099343,5cyclictest131rcu_preempt21:30:132
9350993422,8cyclictest204-21dbus-daemon21:50:582
935099341,4cyclictest131rcu_preempt21:10:132
9346993422,5cyclictest131rcu_preempt23:05:201
9341993428,3cyclictest0-21swapper/019:50:000
9341993427,3cyclictest68494-21kthreadd22:00:010
9341993424,6cyclictest0-21swapper/023:55:010
9350993327,4cyclictest18407-21idleruntime-cro19:35:002
9350993327,4cyclictest13120-21kworker/u8:1+events_unbound19:29:412
9350993326,4cyclictest0-21swapper/219:10:282
9350993326,3cyclictest0-21swapper/223:19:592
9350993324,6cyclictest208-21systemd-logind22:51:102
9350993321,9cyclictest90897-21cron23:04:592
9350993321,9cyclictest90897-21cron23:04:592
934699337,9cyclictest24-21ksoftirqd/119:15:021
9346993327,4cyclictest68204-21kworker/u8:1+events_unbound22:02:421
9346993325,4cyclictest13280-21kthreadd19:20:011
9346993320,5cyclictest131rcu_preempt21:20:081
9346993315,10cyclictest131rcu_preempt22:22:091
9346993314,4cyclictest131rcu_preempt00:08:191
9346993313,6cyclictest131rcu_preempt00:30:221
9341993326,4cyclictest11130-21wc19:15:020
9355993224,4cyclictest0-21swapper/323:30:203
9355993224,4cyclictest0-21swapper/319:15:023
9355993223,6cyclictest0-21swapper/323:55:013
9355993222,6cyclictest71451-21grep22:05:263
9355993222,6cyclictest71451-21grep22:05:263
9355993222,6cyclictest0-21swapper/319:35:263
9355993215,12cyclictest0-21swapper/319:45:253
9350993216,11cyclictest311ktimers/223:05:112
934699325,16cyclictest24-21ksoftirqd/120:00:251
9346993224,4cyclictest0-21swapper/123:45:311
9346993221,8cyclictest231ktimers/120:30:181
9346993220,7cyclictest36910-21grep20:25:251
9346993218,5cyclictest131rcu_preempt19:30:211
9346993218,4cyclictest131rcu_preempt22:18:051
9346993217,4cyclictest131rcu_preempt21:30:141
934199324,3cyclictest131rcu_preempt22:00:120
9341993226,3cyclictest0-21swapper/021:25:120
9341993221,7cyclictest21351-21grep19:40:250
9341993218,10cyclictest26947-21basename20:00:000
9355993122,4cyclictest0-21swapper/322:21:043
9355993121,6cyclictest0-21swapper/322:30:253
9355993121,6cyclictest0-21swapper/321:30:003
9355993120,7cyclictest0-21swapper/321:20:263
9355993120,6cyclictest0-21swapper/322:35:263
935099314,4cyclictest131rcu_preempt23:55:102
9350993125,4cyclictest30177-21kworker/u8:3+events_unbound20:35:442
9350993123,6cyclictest71779-21kworker/u8:2+events_unbound22:31:072
9350993123,4cyclictest0-21swapper/219:50:362
9346993123,4cyclictest0-21swapper/121:25:241
9346993123,4cyclictest0-21swapper/121:20:011
9346993123,4cyclictest0-21swapper/121:20:011
9346993121,7cyclictest104749-21sh23:45:011
9346993117,4cyclictest131rcu_preempt22:10:261
9346993117,4cyclictest131rcu_preempt20:59:541
9346993114,9cyclictest131rcu_preempt23:00:131
9346993114,9cyclictest131rcu_preempt23:00:131
9346993113,4cyclictest131rcu_preempt21:02:081
9346993113,4cyclictest131rcu_preempt00:14:311
9346993113,4cyclictest131rcu_preempt00:14:311
9346993112,10cyclictest131rcu_preempt22:45:191
9346993111,4cyclictest131rcu_preempt00:21:271
9346993110,13cyclictest24-21ksoftirqd/121:45:191
9346993110,13cyclictest131rcu_preempt20:05:011
9341993119,7cyclictest35220-21grep20:20:240
9355993024,3cyclictest0-21swapper/323:00:253
9355993024,3cyclictest0-21swapper/323:00:253
9355993023,4cyclictest0-21swapper/300:25:263
9350993022,5cyclictest30177-21kworker/u8:3+events_unbound21:00:122
9350993022,4cyclictest0-21swapper/220:50:252
9350993018,7cyclictest0-21swapper/221:45:292
935099301,4cyclictest131rcu_preempt22:15:142
935099301,15cyclictest0-21swapper/219:45:132
934699308,6cyclictest24-21ksoftirqd/123:20:241
9346993022,5cyclictest231ktimers/123:35:131
9346993020,7cyclictest231ktimers/120:40:201
9346993019,8cyclictest231ktimers/123:15:011
9346993018,4cyclictest131rcu_preempt22:44:551
9346993017,3cyclictest131rcu_preempt22:25:211
9346993015,4cyclictest131rcu_preempt21:06:441
9346993014,9cyclictest131rcu_preempt23:59:361
9346993014,9cyclictest131rcu_preempt22:38:041
9346993014,9cyclictest131rcu_preempt21:55:201
9346993014,9cyclictest131rcu_preempt21:35:141
9346993014,5cyclictest131rcu_preempt19:35:251
9346993010,6cyclictest131rcu_preempt19:50:221
9341993020,6cyclictest0-21swapper/019:40:010
9355992921,4cyclictest0-21swapper/320:50:223
9355992919,6cyclictest0-21swapper/323:55:233
935099295,4cyclictest131rcu_preempt21:55:122
9350992923,4cyclictest111408-21kworker/u8:0+events_unbound00:16:232
9350992919,6cyclictest0-21swapper/220:20:012
935099291,4cyclictest0-21swapper/222:55:102
9346992919,8cyclictest231ktimers/119:25:231
9346992919,7cyclictest231ktimers/100:00:141
9346992917,4cyclictest131rcu_preempt20:10:211
9346992915,6cyclictest131rcu_preempt23:25:181
9346992915,4cyclictest131rcu_preempt19:45:141
9346992912,5cyclictest131rcu_preempt22:50:241
9346992911,9cyclictest131rcu_preempt20:15:191
934199291,8cyclictest38059-21/usr/sbin/munin20:30:200
9341992918,7cyclictest63785-21tune2fs21:45:190
934199291,7cyclictest114418-21wc00:10:230
934199291,7cyclictest114418-21wc00:10:230
9355992822,3cyclictest0-21swapper/323:40:003
9355992819,6cyclictest0-21swapper/320:20:253
9355992818,6cyclictest0-21swapper/321:15:273
9355992818,6cyclictest0-21swapper/321:15:273
935099285,8cyclictest131rcu_preempt22:10:182
935099282,4cyclictest131rcu_preempt21:40:122
9350992822,4cyclictest102784-21kworker/u8:1+events_unbound23:50:212
9350992821,4cyclictest0-21swapper/200:05:312
9350992820,5cyclictest0-21swapper/220:45:262
9350992817,7cyclictest42497-21sh20:45:012
935099281,10cyclictest1230422sh00:35:232
9341992822,4cyclictest9336-21cyclictest20:10:270
9341992821,4cyclictest0-21swapper/021:15:000
9341992821,3cyclictest0-21swapper/023:40:000
9341992820,4cyclictest13550irq/42-30be0000.ethernet20:40:010
9341992819,5cyclictest0-21swapper/021:00:010
9355992722,3cyclictest49328-21sh21:05:013
9355992720,4cyclictest52763-21latency_hist21:15:003
9355992720,4cyclictest39144-21latency_hist20:35:023
9355992720,4cyclictest0-21swapper/300:30:163
9355992718,4cyclictest0-21swapper/320:05:003
9355992718,4cyclictest0-21swapper/319:20:023
9350992720,4cyclictest69807-21sed22:00:282
9350992717,7cyclictest311ktimers/219:55:122
9341992722,3cyclictest0-21swapper/000:15:110
9341992721,3cyclictest88694-21unixbench_multi22:55:230
9341992717,7cyclictest96457-21tune2fs23:20:170
935599267,9cyclictest40-21ksoftirqd/300:35:233
9355992619,4cyclictest0-21swapper/322:20:013
9355992618,5cyclictest0-21swapper/322:00:013
9355992618,4cyclictest0-21swapper/322:10:263
9355992616,7cyclictest62080-21tune2fs21:40:163
9350992620,3cyclictest0-21swapper/200:20:182
9350992617,6cyclictest93812-21grep23:10:242
935099261,4cyclictest131rcu_preempt23:25:132
9350992613,4cyclictest26652-21kworker/u8:0+events_unbound20:07:032
934199262,6cyclictest80991-21df22:35:150
9341992621,2cyclictest13550irq/42-30be0000.ethernet00:30:040
9341992618,5cyclictest0-21swapper/020:40:240
9341992617,5cyclictest61250-21grep21:35:240
9341992616,6cyclictest0-21swapper/022:45:000
9355992520,2cyclictest0-21swapper/320:05:063
9355992517,5cyclictest0-21swapper/300:20:283
9355992517,4cyclictest0-21swapper/322:50:263
9355992516,6cyclictest110491-21cat00:00:213
9355992515,7cyclictest0-21swapper/323:30:013
935099258,9cyclictest131rcu_preempt20:10:182
935099252,6cyclictest0-21swapper/219:40:112
9350992519,3cyclictest0-21swapper/220:05:012
9350992517,5cyclictest311ktimers/219:20:132
9350992515,7cyclictest119900-21grep00:25:272
934199259,14cyclictest121ktimers/023:10:200
9341992519,4cyclictest0-21swapper/000:25:260
9341992516,6cyclictest49319-21sh21:05:010
9341992515,5cyclictest0-21swapper/020:15:400
9341992514,7cyclictest204-21dbus-daemon23:41:160
934199251,20cyclictest0-21swapper/023:18:230
934199251,20cyclictest0-21swapper/000:20:290
934199251,11cyclictest98400-21meminfo23:25:190
9355992417,5cyclictest87318-21kworker/u8:0+events_unbound23:21:133
9355992417,5cyclictest50537-21unixbench_multi21:05:253
9355992417,4cyclictest0-21swapper/319:50:203
9355992416,5cyclictest0-21swapper/323:40:143
9355992416,5cyclictest0-21swapper/300:10:003
9355992416,4cyclictest0-21swapper/319:25:243
9355992415,6cyclictest77682-21tune2fs22:25:153
9355992415,6cyclictest0-21swapper/321:50:013
9355992414,7cyclictest65898-21ntp_states21:50:233
935099249,3cyclictest131rcu_preempt21:15:202
935099249,3cyclictest131rcu_preempt21:15:192
935099248,7cyclictest131rcu_preempt19:15:152
9350992418,3cyclictest0-21swapper/223:30:302
9350992417,5cyclictest118406-21kworker/u8:1+events_unbound00:30:262
9350992417,4cyclictest438-21cron00:15:002
9350992417,4cyclictest438-21cron00:14:592
9350992416,5cyclictest0-21swapper/223:40:212
935099241,5cyclictest61248-21unixbench_singl21:35:252
9341992416,3cyclictest0-21swapper/020:00:160
9341992414,7cyclictest79926-21mailstats22:30:250
934199241,21cyclictest0-21swapper/022:48:530
934199241,19cyclictest0-21swapper/023:04:270
934199241,19cyclictest0-21swapper/023:04:270
934199241,19cyclictest0-21swapper/021:31:060
934199241,19cyclictest0-21swapper/021:22:450
934199241,19cyclictest0-21swapper/020:29:430
934199241,19cyclictest0-21swapper/019:25:070
9355992317,3cyclictest59044-21ntpq21:30:223
9355992317,3cyclictest0-21swapper/323:10:143
9355992317,3cyclictest0-21swapper/323:10:003
9355992315,5cyclictest0-21swapper/320:15:023
9355992315,4cyclictest96030-21sendmail-msp23:19:593
9355992314,5cyclictest89162-21cron23:00:003
9355992312,8cyclictest20913-21ntp_states19:40:213
935099234,6cyclictest30177-21kworker/u8:3+events_unbound20:59:002
9350992316,5cyclictest99856-21kworker/u8:0+events_unbound23:45:132
9350992316,3cyclictest0-21swapper/222:45:262
9341992316,4cyclictest0-21swapper/022:25:250
9341992316,3cyclictest0-21swapper/023:09:310
9341992316,3cyclictest0-21swapper/000:02:370
9341992315,6cyclictest22288-1kworker/0:2H+mmc_complete00:10:000
934199231,3cyclictest0-21swapper/022:14:020
934199231,3cyclictest0-21swapper/020:50:260
934199231,19cyclictest109382-21grep23:55:230
934199231,18cyclictest0-21swapper/020:46:460
934199231,18cyclictest0-21swapper/019:54:110
934199230,19cyclictest0-21swapper/023:33:320
934199230,19cyclictest0-21swapper/021:07:070
9355992215,5cyclictest391ktimers/320:45:123
9355992215,4cyclictest41570-21ntpq20:40:213
9350992216,3cyclictest0-21swapper/222:05:182
9350992216,3cyclictest0-21swapper/222:05:172
9350992212,6cyclictest0-21swapper/222:25:202
9341992217,3cyclictest0-21swapper/021:50:080
9341992217,3cyclictest0-21swapper/021:40:030
9341992216,3cyclictest0-21swapper/019:15:200
934199221,2cyclictest0-21swapper/022:50:140
9355992114,4cyclictest0-21swapper/322:00:273
9355992113,5cyclictest0-21swapper/323:45:243
9355992113,5cyclictest0-21swapper/320:35:233
9350992116,2cyclictest0-21swapper/221:20:182
9350992112,6cyclictest204-21dbus-daemon22:21:052
9350992112,5cyclictest0-21swapper/200:00:302
9350992110,4cyclictest131rcu_preempt20:25:142
9350991813,3cyclictest34689-21missed_timers20:20:202
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional