You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-04 - 15:12

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #9, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Kontron
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack9slot3s.osadl.org (updated Fri Sep 04, 2026 12:44:53)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
119591630,41ptp4l0-21swapper/007:05:130
119591620,40ptp4l0-21swapper/107:05:191
1763925144,2sleep30-21swapper/307:09:273
1525925046,2sleep20-21swapper/207:05:072
39132450,0sleep03905-21perf09:45:000
119591310,0ptp4l0-21swapper/012:30:180
119591220,0ptp4l0-21swapper/008:10:140
119591210,0ptp4l0-21swapper/109:45:011
119591190,0ptp4l0-21swapper/112:30:131
119591190,0ptp4l0-21swapper/012:05:150
119591180,0ptp4l0-21swapper/111:20:221
119591180,0ptp4l0-21swapper/110:40:221
119591180,0ptp4l0-21swapper/108:30:211
119591180,0ptp4l0-21swapper/108:25:141
119591180,0ptp4l0-21swapper/007:10:420
119591170,0ptp4l0-21swapper/209:55:152
119591170,0ptp4l0-21swapper/011:30:260
1794399164,8cyclictest0-21swapper/109:25:121
119591160,1ptp4l12469-21apt-get09:00:110
119591160,0ptp4l0-21swapper/008:45:150
119591150,1ptp4l8672-21snmp_o5powerctl09:50:231
119591150,1ptp4l5039-21hddtemp_smartct09:45:140
119591150,1ptp4l29980-21ntp_states09:30:180
119591150,1ptp4l29719-21ls10:30:160
119591150,1ptp4l25947-21apt-get09:25:110
119591150,1ptp4l23344-21cpuspeed_turbos10:20:131
119591150,1ptp4l22987-21apt-get11:20:130
119591150,1ptp4l18905-21grep10:10:221
119591150,1ptp4l16790-21snmp_o5powerctl09:05:220
119591150,0ptp4l0-21swapper/111:50:341
119591150,0ptp4l0-21swapper/111:45:121
119591150,0ptp4l0-21swapper/111:30:191
119591150,0ptp4l0-21swapper/111:25:111
119591150,0ptp4l0-21swapper/111:25:111
119591150,0ptp4l0-21swapper/111:10:171
119591150,0ptp4l0-21swapper/111:05:111
119591150,0ptp4l0-21swapper/110:50:151
119591150,0ptp4l0-21swapper/110:30:201
119591150,0ptp4l0-21swapper/107:20:111
119591150,0ptp4l0-21swapper/012:35:020
119591150,0ptp4l0-21swapper/012:10:050
119591150,0ptp4l0-21swapper/011:04:420
119591150,0ptp4l0-21swapper/010:00:120
119591150,0ptp4l0-21swapper/008:55:110
119591150,0ptp4l0-21swapper/007:15:130
119591140,1ptp4l9727-21cpuspeed_turbos10:55:130
119591140,1ptp4l8077-21cstates07:50:130
119591140,1ptp4l4166-21/usr/sbin/munin10:45:132
119591140,1ptp4l3002-21snmp_o5powerctl10:40:210
119591140,1ptp4l27319-21ps10:25:191
119591140,1ptp4l27077-21needreboot10:25:170
119591140,1ptp4l26982-21awk11:25:180
119591140,1ptp4l26982-21awk11:25:170
119591140,1ptp4l24811-21snmp_o5powerctl10:20:220
119591140,1ptp4l24568-21ls07:20:130
119591140,1ptp4l2431-21/usr/sbin/munin07:40:140
119591140,1ptp4l19607-21missed_timers08:10:171
119591140,1ptp4l14256-21unixbench_multi10:00:241
119591140,1ptp4l12887-21latency_hist08:00:010
119591140,1ptp4l10709-21ntp_states11:55:200
119591140,0ptp4l0-21swapper/211:50:012
119591140,0ptp4l0-21swapper/207:40:172
119591140,0ptp4l0-21swapper/112:26:421
119591140,0ptp4l0-21swapper/112:01:401
119591140,0ptp4l0-21swapper/111:00:201
119591140,0ptp4l0-21swapper/110:15:021
119591140,0ptp4l0-21swapper/110:05:211
119591140,0ptp4l0-21swapper/109:15:021
119591140,0ptp4l0-21swapper/109:10:171
119591140,0ptp4l0-21swapper/109:05:121
119591140,0ptp4l0-21swapper/109:00:181
119591140,0ptp4l0-21swapper/108:55:161
119591140,0ptp4l0-21swapper/108:45:141
119591140,0ptp4l0-21swapper/108:35:141
119591140,0ptp4l0-21swapper/108:20:111
119591140,0ptp4l0-21swapper/108:15:171
119591140,0ptp4l0-21swapper/108:02:141
119591140,0ptp4l0-21swapper/107:54:351
119591140,0ptp4l0-21swapper/107:45:211
119591140,0ptp4l0-21swapper/107:40:211
119591140,0ptp4l0-21swapper/107:15:201
119591140,0ptp4l0-21swapper/107:10:231
119591140,0ptp4l0-21swapper/012:25:230
119591140,0ptp4l0-21swapper/012:20:150
119591140,0ptp4l0-21swapper/011:35:240
119591140,0ptp4l0-21swapper/011:05:210
119591140,0ptp4l0-21swapper/010:50:260
119591140,0ptp4l0-21swapper/010:05:200
119591140,0ptp4l0-21swapper/009:55:210
119591140,0ptp4l0-21swapper/009:50:430
119591140,0ptp4l0-21swapper/009:15:200
119591140,0ptp4l0-21swapper/009:10:110
119591140,0ptp4l0-21swapper/008:20:140
119591140,0ptp4l0-21swapper/008:00:170
119591140,0ptp4l0-21swapper/007:26:270
8332130,0sleep20-21swapper/212:40:012
119591130,1ptp4l31481-21expr09:35:120
119591130,0ptp4l0-21swapper/212:20:162
119591130,0ptp4l0-21swapper/210:50:172
119591130,0ptp4l0-21swapper/210:25:132
119591130,0ptp4l0-21swapper/209:35:112
119591130,0ptp4l0-21swapper/208:45:232
119591130,0ptp4l0-21swapper/208:25:242
119591130,0ptp4l0-21swapper/208:20:492
119591130,0ptp4l0-21swapper/207:45:112
119591130,0ptp4l0-21swapper/207:30:222
119591130,0ptp4l0-21swapper/207:20:142
119591130,0ptp4l0-21swapper/112:35:121
119591130,0ptp4l0-21swapper/112:20:141
119591130,0ptp4l0-21swapper/112:15:141
119591130,0ptp4l0-21swapper/112:10:181
119591130,0ptp4l0-21swapper/112:05:151
119591130,0ptp4l0-21swapper/111:55:151
119591130,0ptp4l0-21swapper/111:40:151
119591130,0ptp4l0-21swapper/111:35:011
119591130,0ptp4l0-21swapper/111:15:111
119591130,0ptp4l0-21swapper/110:55:141
119591130,0ptp4l0-21swapper/110:45:121
119591130,0ptp4l0-21swapper/110:35:131
119591130,0ptp4l0-21swapper/109:55:141
119591130,0ptp4l0-21swapper/109:40:011
119591130,0ptp4l0-21swapper/109:35:131
119591130,0ptp4l0-21swapper/109:30:131
119591130,0ptp4l0-21swapper/109:20:131
119591130,0ptp4l0-21swapper/109:20:131
119591130,0ptp4l0-21swapper/108:50:151
119591130,0ptp4l0-21swapper/108:40:151
119591130,0ptp4l0-21swapper/108:05:141
119591130,0ptp4l0-21swapper/107:55:111
119591130,0ptp4l0-21swapper/107:35:101
119591130,0ptp4l0-21swapper/107:30:151
119591130,0ptp4l0-21swapper/107:25:141
119591130,0ptp4l0-21swapper/012:15:120
119591130,0ptp4l0-21swapper/012:00:160
119591130,0ptp4l0-21swapper/011:50:180
119591130,0ptp4l0-21swapper/011:45:140
119591130,0ptp4l0-21swapper/011:40:130
119591130,0ptp4l0-21swapper/011:15:120
119591130,0ptp4l0-21swapper/011:10:220
119591130,0ptp4l0-21swapper/010:45:140
119591130,0ptp4l0-21swapper/010:35:150
119591130,0ptp4l0-21swapper/010:15:140
119591130,0ptp4l0-21swapper/010:10:210
119591130,0ptp4l0-21swapper/009:20:130
119591130,0ptp4l0-21swapper/009:20:120
119591130,0ptp4l0-21swapper/008:50:140
119591130,0ptp4l0-21swapper/008:40:120
119591130,0ptp4l0-21swapper/008:35:160
119591130,0ptp4l0-21swapper/008:30:190
119591130,0ptp4l0-21swapper/008:25:130
119591130,0ptp4l0-21swapper/008:15:120
119591130,0ptp4l0-21swapper/008:05:180
119591130,0ptp4l0-21swapper/007:45:150
119591130,0ptp4l0-21swapper/007:35:110
119591130,0ptp4l0-21swapper/007:30:120
119591120,0ptp4l0-21swapper/211:15:202
119591120,0ptp4l0-21swapper/211:10:262
119591120,0ptp4l0-21swapper/207:51:232
119591120,0ptp4l0-21swapper/207:27:072
1794499110,8cyclictest0-21swapper/209:45:012
119591100,2ptp4l0-21swapper/212:13:172
119591100,1ptp4l0-21swapper/212:20:002
119591100,0ptp4l0-21swapper/307:23:423
179459997,1cyclictest9053-21taskset09:50:393
179459997,1cyclictest62672sleep310:45:533
179459997,1cyclictest27443-21chrt12:27:213
179459997,1cyclictest24652-21chrt12:20:303
179459997,1cyclictest23104-21taskset10:20:043
179459997,1cyclictest21653-21nfs4_client11:15:153
179459997,1cyclictest20094-21taskset07:11:223
179459997,1cyclictest14810-21date08:00:223
179459997,1cyclictest14522-21chrt10:02:413
179459997,1cyclictest116892sleep309:55:323
179459997,1cyclictest10235-21cat10:55:163
179459990,8cyclictest23420-21ls08:20:013
179449997,1cyclictest21001-21snmp_o5powerctl07:15:022
179449997,1cyclictest14381-21seq10:00:502
179449997,1cyclictest13719-21grep08:00:152
179449997,1cyclictest1024-21taskset10:39:442
179449990,8cyclictest11831-21vmstat08:55:232
11959190,1ptp4l17529-21diskmemload12:31:182
11959190,0ptp4l33-21ksoftirqd/208:52:132
11959190,0ptp4l0-21swapper/212:28:412
11959190,0ptp4l0-21swapper/212:08:202
11959190,0ptp4l0-21swapper/212:04:342
11959190,0ptp4l0-21swapper/211:55:332
11959190,0ptp4l0-21swapper/211:39:392
11959190,0ptp4l0-21swapper/211:31:432
11959190,0ptp4l0-21swapper/211:22:082
11959190,0ptp4l0-21swapper/211:00:292
11959190,0ptp4l0-21swapper/210:55:112
11959190,0ptp4l0-21swapper/210:34:232
11959190,0ptp4l0-21swapper/210:17:142
11959190,0ptp4l0-21swapper/209:41:192
11959190,0ptp4l0-21swapper/209:30:292
11959190,0ptp4l0-21swapper/209:26:222
11959190,0ptp4l0-21swapper/209:18:342
11959190,0ptp4l0-21swapper/209:12:082
11959190,0ptp4l0-21swapper/209:00:272
11959190,0ptp4l0-21swapper/208:17:152
11959190,0ptp4l0-21swapper/208:09:482
11959190,0ptp4l0-21swapper/207:55:172
179459986,1cyclictest9930-21grep11:55:163
179459986,1cyclictest7906-21if_enp0s31f608:50:173
179459986,1cyclictest7333-21cat10:50:183
179459986,1cyclictest7119-21expr11:50:183
179459986,1cyclictest6024-21cut07:45:163
179459986,1cyclictest460-21snmp_o5powerctl09:35:203
179459986,1cyclictest4328-21basename09:45:103
179459986,1cyclictest4159-21chrt08:43:463
179459986,1cyclictest4152-21expr11:45:123
179459986,1cyclictest3297-21cat07:40:163
179459986,1cyclictest32722-21fschecks_count07:35:123
179459986,1cyclictest3260-21grep10:40:233
179459986,1cyclictest31734-21if_enp4s011:35:183
179459986,1cyclictest31601-21cat08:35:143
179459986,1cyclictest31145-21expr12:35:123
179459986,1cyclictest31045-21cut07:30:183
179459986,1cyclictest30382-21timerandwakeup09:30:223
179459986,1cyclictest29885-21sendmail_mailst11:30:243
179459986,1cyclictest29275-21expr08:30:133
179459986,1cyclictest28678-21cut10:30:123
179459986,1cyclictest27192-21cat08:25:163
179459986,1cyclictest26938-21expr10:25:173
179459986,1cyclictest26889-21basename07:25:123
179459986,1cyclictest26645-21hwlatdetect09:25:153
179459986,1cyclictest26038-21chrt08:24:423
179459986,1cyclictest25596-21taskset11:25:063
179459986,1cyclictest25596-21taskset11:25:053
179459986,1cyclictest23614-21expr09:20:143
179459986,1cyclictest23614-21expr09:20:133
179459986,1cyclictest23193-21tr11:20:153
179459986,1cyclictest21981-21taskset12:15:293
179459986,1cyclictest21897-21sed09:15:163
179459986,1cyclictest21771-21expr07:15:143
179459986,1cyclictest20839-21expr10:15:153
179459986,1cyclictest1973-21diskstats09:40:143
179459986,1cyclictest18565-21wc08:10:133
179459986,1cyclictest18420-21uname12:10:163
179459986,1cyclictest18177-21sort08:10:023
179459986,1cyclictest18042-21tr09:10:133
179459986,1cyclictest18021-21expr11:10:193
179459986,1cyclictest17580-21chrt10:10:143
179459986,1cyclictest16728-21chrt12:06:083
179459986,1cyclictest16191-21grep11:05:163
179459986,1cyclictest15344-21expr10:05:133
179459986,1cyclictest150842sleep309:05:093
179459986,1cyclictest13811-21tail11:00:183
179459986,1cyclictest127392sleep307:59:273
179459986,1cyclictest125972sleep309:00:123
179459986,1cyclictest1240-21aten2.4-expect11:40:143
179459986,1cyclictest11983-21bc12:00:123
179459986,1cyclictest10426-21head08:55:133
179459986,1cyclictest101192sleep307:54:423
179459984,1cyclictest27902-21apt-get12:30:103
179449987,1cyclictest7560-21grep09:50:162
179449986,1cyclictest4074-21tr11:45:122
179449986,1cyclictest3349-21pmu-power08:40:202
179449986,1cyclictest3303-21seq11:41:392
179449986,1cyclictest32749-21cut07:35:132
179449986,1cyclictest31647-21tail08:35:142
179449986,1cyclictest29606-21expr08:30:152
179449986,1cyclictest25745-21basename11:25:132
179449986,1cyclictest25745-21basename11:25:122
179449986,1cyclictest23361-21cut10:20:132
179449986,1cyclictest20443-21taskset08:11:032
179449986,1cyclictest19660-21snmp_o5powerctl07:10:222
179449986,1cyclictest16997-21taskset10:05:292
179449986,1cyclictest15342-21grep09:05:132
179449986,1cyclictest1532-21cat10:40:142
179449986,1cyclictest15125-21basename11:05:122
179449981,5cyclictest0-21swapper/209:20:132
179449981,5cyclictest0-21swapper/209:20:122
11959180,0ptp4l0-21swapper/210:10:102
179459976,1cyclictest5814-21grep08:45:183
179459975,1cyclictest31936-21if_err_enp3s010:35:183
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional