You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-25 - 14:51

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #9, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Kontron
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack9slot3s.osadl.org (updated Wed Mar 25, 2026 12:44:55)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
119591650,45ptp4l0-21swapper/007:07:330
119591600,43ptp4l0-21swapper/107:07:271
167862540,0sleep00-21swapper/008:55:170
2290125147,2sleep30-21swapper/307:07:553
2016325042,2sleep20-21swapper/207:05:022
255552460,0sleep10-21swapper/111:15:131
302842440,0sleep10-21swapper/107:20:171
119591420,28ptp4l0-21swapper/007:10:010
119591310,0ptp4l0-21swapper/212:35:122
119591310,0ptp4l0-21swapper/011:25:200
119591250,0ptp4l0-21swapper/010:39:570
23326992424,0cyclictest41-21ksoftirqd/307:40:113
119591220,0ptp4l0-21swapper/107:10:211
23326992020,0cyclictest41-21ksoftirqd/308:25:213
119591200,0ptp4l0-21swapper/111:05:201
119591190,0ptp4l0-21swapper/110:05:131
119591190,0ptp4l0-21swapper/109:35:161
119591190,0ptp4l0-21swapper/012:05:190
119591180,0ptp4l0-21swapper/009:10:240
23326991714,1cyclictest41-21ksoftirqd/309:05:003
119591170,0ptp4l0-21swapper/109:45:151
119591170,0ptp4l0-21swapper/108:50:251
119591170,0ptp4l0-21swapper/010:15:130
2332699166,3cyclictest41-21ksoftirqd/310:20:143
23326991613,2cyclictest41-21ksoftirqd/309:15:143
23325991616,0cyclictest33-21ksoftirqd/211:40:232
119591160,1ptp4l9360-21apt-get10:45:110
119591160,0ptp4l0-21swapper/112:30:151
119591160,0ptp4l0-21swapper/111:30:141
119591160,0ptp4l0-21swapper/009:25:250
119591160,0ptp4l0-21swapper/009:09:270
119591160,0ptp4l0-21swapper/007:50:180
119591150,1ptp4l9866-21apt-get08:45:021
119591150,1ptp4l9127-21perf10:45:010
119591150,1ptp4l6255-21snmp_o5powerctl08:35:210
119591150,1ptp4l5344-21snmp_o5powerctl11:35:210
119591150,1ptp4l3701-21ntp_states07:30:190
119591150,1ptp4l31173-21apt-get10:25:121
119591150,1ptp4l30735-21snmp_o5powerctl08:20:230
119591150,1ptp4l30196-21snmp_o5powerctl10:20:240
119591150,1ptp4l2629-21hddtemp_smartct08:30:151
119591150,1ptp4l26280-21awk12:15:181
119591150,1ptp4l25413-21snmp_o5powerctl08:10:221
119591150,1ptp4l23092-21apt-config10:10:020
119591150,1ptp4l22764-21snmp_o5powerctl08:05:230
119591150,1ptp4l226-21systemd-journal11:50:011
119591150,1ptp4l22596-21snmp_o5powerctl09:05:221
119591150,1ptp4l18986-21snmp_o5powerctl11:00:221
119591150,1ptp4l1705-21perf08:30:021
119591150,1ptp4l16319-21snmp_o5powerctl10:55:211
119591150,1ptp4l14885-21ls07:50:241
119591150,1ptp4l11940-21snmp_o5powerctl07:45:221
119591150,1ptp4l11032-21snmp_o5powerctl10:45:221
119591150,1ptp4l10809-21ls11:45:222
119591150,0ptp4l23200-21apt-get10:10:111
119591150,0ptp4l0-21swapper/111:50:221
119591150,0ptp4l0-21swapper/111:35:111
119591150,0ptp4l0-21swapper/110:50:221
119591150,0ptp4l0-21swapper/109:40:121
119591150,0ptp4l0-21swapper/109:20:141
119591150,0ptp4l0-21swapper/109:20:131
119591150,0ptp4l0-21swapper/108:55:131
119591150,0ptp4l0-21swapper/108:35:231
119591150,0ptp4l0-21swapper/107:40:021
119591150,0ptp4l0-21swapper/107:15:231
119591150,0ptp4l0-21swapper/009:55:510
119591150,0ptp4l0-21swapper/009:41:570
119591150,0ptp4l0-21swapper/009:04:420
119591150,0ptp4l0-21swapper/007:15:130
2332699146,3cyclictest41-21ksoftirqd/309:05:163
2332499142,3cyclictest0-21swapper/110:20:141
119591140,1ptp4l972-21snmpd12:10:122
119591140,1ptp4l9-21ksoftirqd/011:15:140
119591140,1ptp4l8092-21df07:40:130
119591140,1ptp4l32763-21memory09:25:181
119591140,1ptp4l31361-21fschecks_time11:25:141
119591140,1ptp4l29232-21snmp_o5powerctl12:20:210
119591140,1ptp4l2782-21df07:30:141
119591140,1ptp4l27340-21irqstats09:15:171
119591140,1ptp4l26701-21df_inode09:15:140
119591140,1ptp4l25089-21awk08:10:190
119591140,1ptp4l23600-21grep12:10:190
119591140,1ptp4l23321-21cyclictest12:35:201
119591140,1ptp4l18905-21df08:00:131
119591140,1ptp4l18801-21irqstats10:00:170
119591140,1ptp4l16662-21grep07:55:171
119591140,1ptp4l15525-21missed_timers11:55:180
119591140,1ptp4l13440-21df_inode08:50:160
119591140,1ptp4l12761-21if_enp2s010:50:160
119591140,1ptp4l1167-21cpu11:30:130
119591140,0ptp4l22005-21smartctl10:05:220
119591140,0ptp4l14650-21apt-get10:55:120
119591140,0ptp4l0-21swapper/207:40:222
119591140,0ptp4l0-21swapper/112:20:141
119591140,0ptp4l0-21swapper/112:05:211
119591140,0ptp4l0-21swapper/112:00:101
119591140,0ptp4l0-21swapper/111:20:211
119591140,0ptp4l0-21swapper/111:10:191
119591140,0ptp4l0-21swapper/110:40:111
119591140,0ptp4l0-21swapper/110:30:101
119591140,0ptp4l0-21swapper/110:15:211
119591140,0ptp4l0-21swapper/108:40:011
119591140,0ptp4l0-21swapper/108:20:231
119591140,0ptp4l0-21swapper/107:35:171
119591140,0ptp4l0-21swapper/107:29:461
119591140,0ptp4l0-21swapper/012:25:220
119591140,0ptp4l0-21swapper/011:50:220
119591140,0ptp4l0-21swapper/011:46:540
119591140,0ptp4l0-21swapper/011:05:020
119591140,0ptp4l0-21swapper/010:30:180
119591140,0ptp4l0-21swapper/010:25:180
119591140,0ptp4l0-21swapper/009:30:250
119591140,0ptp4l0-21swapper/008:40:240
119591140,0ptp4l0-21swapper/008:30:230
119591140,0ptp4l0-21swapper/008:03:250
119591140,0ptp4l0-21swapper/007:49:260
2332699138,3cyclictest41-21ksoftirqd/312:30:023
2332699134,3cyclictest41-21ksoftirqd/309:50:173
119591130,1ptp4l787-21cstates12:30:140
119591130,0ptp4l0-21swapper/211:50:242
119591130,0ptp4l0-21swapper/211:00:162
119591130,0ptp4l0-21swapper/210:55:232
119591130,0ptp4l0-21swapper/210:20:212
119591130,0ptp4l0-21swapper/209:10:232
119591130,0ptp4l0-21swapper/208:55:232
119591130,0ptp4l0-21swapper/208:20:162
119591130,0ptp4l0-21swapper/208:00:152
119591130,0ptp4l0-21swapper/207:35:162
119591130,0ptp4l0-21swapper/112:25:151
119591130,0ptp4l0-21swapper/112:10:141
119591130,0ptp4l0-21swapper/111:55:151
119591130,0ptp4l0-21swapper/111:40:121
119591130,0ptp4l0-21swapper/110:35:141
119591130,0ptp4l0-21swapper/110:00:141
119591130,0ptp4l0-21swapper/109:55:121
119591130,0ptp4l0-21swapper/109:50:141
119591130,0ptp4l0-21swapper/109:30:141
119591130,0ptp4l0-21swapper/109:10:131
119591130,0ptp4l0-21swapper/109:00:021
119591130,0ptp4l0-21swapper/108:15:131
119591130,0ptp4l0-21swapper/108:05:151
119591130,0ptp4l0-21swapper/012:35:110
119591130,0ptp4l0-21swapper/012:15:150
119591130,0ptp4l0-21swapper/012:00:120
119591130,0ptp4l0-21swapper/011:40:120
119591130,0ptp4l0-21swapper/011:20:150
119591130,0ptp4l0-21swapper/011:10:140
119591130,0ptp4l0-21swapper/011:00:110
119591130,0ptp4l0-21swapper/009:50:140
119591130,0ptp4l0-21swapper/009:45:160
119591130,0ptp4l0-21swapper/009:35:140
119591130,0ptp4l0-21swapper/009:20:160
119591130,0ptp4l0-21swapper/009:20:150
119591130,0ptp4l0-21swapper/008:45:120
119591130,0ptp4l0-21swapper/008:25:170
119591130,0ptp4l0-21swapper/008:15:160
119591130,0ptp4l0-21swapper/007:55:180
119591130,0ptp4l0-21swapper/007:35:180
119591130,0ptp4l0-21swapper/007:25:130
119591130,0ptp4l0-21swapper/007:20:130
119591120,0ptp4l0-21swapper/211:05:152
119591120,0ptp4l0-21swapper/209:05:162
119591120,0ptp4l0-21swapper/209:00:182
119591120,0ptp4l0-21swapper/208:15:142
119591120,0ptp4l0-21swapper/208:10:222
119591120,0ptp4l0-21swapper/208:05:142
2332699119,1cyclictest41-21ksoftirqd/307:10:223
2332699117,2cyclictest41-21ksoftirqd/311:25:213
2332699113,2cyclictest41-21ksoftirqd/309:35:223
2332699111,0cyclictest41-21ksoftirqd/308:30:133
2332699110,5cyclictest0-21swapper/310:15:123
119591110,0ptp4l0-21swapper/212:22:262
119591110,0ptp4l0-21swapper/211:39:572
119591110,0ptp4l0-21swapper/207:45:252
2332699109,1cyclictest41-21ksoftirqd/308:10:133
2332699109,0cyclictest41-21ksoftirqd/309:45:013
2332699108,0cyclictest41-21ksoftirqd/312:15:193
2332699107,0cyclictest41-21ksoftirqd/312:30:133
2332699105,3cyclictest41-21ksoftirqd/309:30:133
2332699105,3cyclictest41-21ksoftirqd/309:10:133
2332699103,0cyclictest41-21ksoftirqd/310:10:213
2332699102,3cyclictest41-21ksoftirqd/308:20:143
23326991010,0cyclictest41-21ksoftirqd/310:10:013
2332699100,2cyclictest0-21swapper/310:35:123
119591100,2ptp4l0-21swapper/211:18:092
119591100,1ptp4l0-21swapper/209:59:152
119591100,0ptp4l0-21swapper/208:34:262
119591100,0ptp4l0-21swapper/207:25:072
233269999,0cyclictest41-21ksoftirqd/311:55:143
233269997,1cyclictest6709-21cat07:35:233
233269997,1cyclictest5305-21taskset11:35:203
233269997,1cyclictest3476-21chrt10:30:513
233269997,1cyclictest28464-21expr11:20:133
233269997,1cyclictest13099-21chrt07:50:103
233269997,1cyclictest12953-21cat08:50:143
233269994,3cyclictest41-21ksoftirqd/308:40:123
233269993,3cyclictest41-21ksoftirqd/312:10:183
233269992,3cyclictest41-21ksoftirqd/312:20:143
233269992,3cyclictest41-21ksoftirqd/311:45:173
233269992,2cyclictest41-21ksoftirqd/309:25:173
233269991,2cyclictest41-21ksoftirqd/312:05:013
233269990,8cyclictest0-21swapper/307:20:243
233259997,1cyclictest4350-21wc09:35:012
233259997,1cyclictest29707-21expr07:20:152
233259997,1cyclictest26515-21open_inodes07:15:022
233259997,1cyclictest19355-21sh10:00:212
11959190,1ptp4l0-21swapper/209:40:532
11959190,0ptp4l0-21swapper/212:32:222
11959190,0ptp4l0-21swapper/212:25:032
11959190,0ptp4l0-21swapper/212:17:162
11959190,0ptp4l0-21swapper/212:08:292
11959190,0ptp4l0-21swapper/212:00:032
11959190,0ptp4l0-21swapper/211:56:102
11959190,0ptp4l0-21swapper/211:30:252
11959190,0ptp4l0-21swapper/211:20:272
11959190,0ptp4l0-21swapper/211:12:052
11959190,0ptp4l0-21swapper/210:50:572
11959190,0ptp4l0-21swapper/210:45:592
11959190,0ptp4l0-21swapper/210:41:352
11959190,0ptp4l0-21swapper/210:35:102
11959190,0ptp4l0-21swapper/210:30:082
11959190,0ptp4l0-21swapper/210:28:522
11959190,0ptp4l0-21swapper/210:15:052
11959190,0ptp4l0-21swapper/210:12:572
11959190,0ptp4l0-21swapper/210:09:552
11959190,0ptp4l0-21swapper/209:50:502
11959190,0ptp4l0-21swapper/209:45:022
11959190,0ptp4l0-21swapper/209:36:002
11959190,0ptp4l0-21swapper/209:29:482
11959190,0ptp4l0-21swapper/209:21:062
11959190,0ptp4l0-21swapper/209:21:062
11959190,0ptp4l0-21swapper/209:16:192
11959190,0ptp4l0-21swapper/208:51:292
11959190,0ptp4l0-21swapper/208:38:002
11959190,0ptp4l0-21swapper/208:25:432
11959190,0ptp4l0-21swapper/207:58:432
11959190,0ptp4l0-21swapper/207:50:472
11959190,0ptp4l0-21swapper/207:33:382
11959190,0ptp4l0-21swapper/207:12:132
233269988,0cyclictest41-21ksoftirqd/310:50:123
233269988,0cyclictest41-21ksoftirqd/309:20:143
233269988,0cyclictest41-21ksoftirqd/309:20:133
233269987,1cyclictest41-21ksoftirqd/307:45:133
233269987,0cyclictest41-21ksoftirqd/309:45:183
233269986,1cyclictest7985-21cat10:40:173
233269986,1cyclictest682-21sed07:25:153
233269986,1cyclictest66812sleep308:36:143
233269986,1cyclictest6629-21cat11:40:123
233269986,1cyclictest3214-21egrep12:35:113
233269986,1cyclictest31142-21chrt10:25:113
233269986,1cyclictest27247-21cat11:15:233
233269986,1cyclictest27009-21expr07:15:153
233269986,1cyclictest26459-21basename08:15:133
233269986,1cyclictest2520-21tr07:30:133
233269986,1cyclictest22908-21aten2.4-expect11:10:123
233269986,1cyclictest22752-21sensors08:05:213
233269986,1cyclictest20507-21cut12:05:153
233269986,1cyclictest20202-21head11:05:123
233269986,1cyclictest18820-21cat08:00:133
233269986,1cyclictest18022-21expr10:00:133
233269986,1cyclictest17440-21smartctl07:55:213
233269986,1cyclictest17372-21cut11:00:113
233269986,1cyclictest15716-21hostname08:55:123
233269986,1cyclictest14625-21cat10:55:113
233269986,1cyclictest11487-21chrt10:46:363
233269986,1cyclictest10549-21grep08:45:133
233269986,1cyclictest1050-21cut11:30:123
233259986,1cyclictest7506-21cut08:40:132
233259986,1cyclictest31445-21head11:25:142
11959180,0ptp4l0-21swapper/208:45:052
233269975,1cyclictest15013-21bc09:55:103
233269972,2cyclictest41-21ksoftirqd/311:50:113
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional