You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-05 - 19:09

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #9, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Kontron
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack9slot3s.osadl.org (updated Sun Jul 05, 2026 12:44:52)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
119591710,50ptp4l0-21swapper/007:06:480
119591670,50ptp4l0-21swapper/107:08:071
2171625444,5sleep30-21swapper/307:05:533
119591510,33ptp4l0-21swapper/207:09:482
296702420,0sleep10-21swapper/109:20:221
119591310,0ptp4l0-21swapper/109:40:121
119591260,0ptp4l0-21swapper/011:15:250
119591250,0ptp4l0-21swapper/010:41:190
119591230,0ptp4l0-21swapper/011:40:170
119591180,0ptp4l0-21swapper/110:05:221
119591180,0ptp4l0-21swapper/108:25:161
119591180,0ptp4l0-21swapper/010:50:180
119591180,0ptp4l0-21swapper/007:10:180
22297991716,0cyclictest33-21ksoftirqd/211:40:002
119591170,0ptp4l0-21swapper/110:55:181
119591170,0ptp4l0-21swapper/108:10:251
119591170,0ptp4l0-21swapper/008:50:210
119591160,1ptp4l26129-21snmp_o5powerctl11:15:221
119591160,1ptp4l24615-21apt-get10:15:110
119591160,1ptp4l22348-21apt-get09:10:121
119591160,1ptp4l11146-21apt-get09:50:130
119591160,1ptp4l10760-21snmp_o5powerctl08:45:220
119591160,0ptp4l0-21swapper/112:05:181
119591160,0ptp4l0-21swapper/111:35:171
119591160,0ptp4l0-21swapper/110:10:121
119591160,0ptp4l0-21swapper/012:20:150
119591160,0ptp4l0-21swapper/012:20:140
119591160,0ptp4l0-21swapper/010:30:210
119591160,0ptp4l0-21swapper/007:15:040
119591150,1ptp4l9838-21python11:45:210
119591150,1ptp4l886-21hddtemp_smartct11:30:151
119591150,1ptp4l4860-21snmp_o5powerctl09:35:230
119591150,1ptp4l4253-21diskstats08:35:160
119591150,1ptp4l3806-21irqstats12:35:171
119591150,1ptp4l31984-21snmp_o5powerctl09:25:221
119591150,1ptp4l31494-21snmp_o5powerctl12:25:221
119591150,1ptp4l31149-21df08:25:130
119591150,1ptp4l30779-21df_inode09:25:140
119591150,1ptp4l30083-21snmp_o5powerctl07:20:230
119591150,1ptp4l23629-21ls11:10:230
119591150,1ptp4l21365-21snmp_o5powerctl09:05:232
119591150,1ptp4l2043-21python10:30:211
119591150,1ptp4l20325-21df_inode08:05:131
119591150,1ptp4l18679-21/usr/sbin/munin09:00:220
119591150,1ptp4l17895-21ntp_states11:00:210
119591150,1ptp4l15301-21snmp_o5powerctl10:55:230
119591150,1ptp4l15006-21memory09:55:190
119591150,1ptp4l11562-21cat11:50:161
119591150,1ptp4l10788-21/usr/sbin/munin11:50:200
119591150,1ptp4l10631-21ntp_states07:45:200
119591150,1ptp4l10564-21pmu-power08:45:211
119591150,0ptp4l0-21swapper/212:20:122
119591150,0ptp4l0-21swapper/212:20:112
119591150,0ptp4l0-21swapper/211:45:132
119591150,0ptp4l0-21swapper/207:40:012
119591150,0ptp4l0-21swapper/112:10:151
119591150,0ptp4l0-21swapper/111:42:031
119591150,0ptp4l0-21swapper/110:00:231
119591150,0ptp4l0-21swapper/108:38:281
119591150,0ptp4l0-21swapper/107:55:171
119591150,0ptp4l0-21swapper/107:10:131
119591150,0ptp4l0-21swapper/012:15:200
119591150,0ptp4l0-21swapper/011:25:030
119591150,0ptp4l0-21swapper/011:20:120
119591150,0ptp4l0-21swapper/010:05:130
119591150,0ptp4l0-21swapper/009:40:230
119591150,0ptp4l0-21swapper/008:40:120
119591150,0ptp4l0-21swapper/007:50:110
119591140,2ptp4l0-21swapper/109:35:241
119591140,1ptp4l4694-21snmp_o5powerctl10:35:231
119591140,1ptp4l30104-21switchtime07:20:231
119591140,1ptp4l26262-21irqstats08:15:170
119591140,1ptp4l25377-21/usr/sbin/munin10:15:161
119591140,1ptp4l25-21ksoftirqd/107:25:131
119591140,1ptp4l22148-21cat11:10:131
119591140,1ptp4l17489-21wc08:00:151
119591140,1ptp4l17021-21ps12:00:160
119591140,1ptp4l14730-21sed11:55:191
119591140,1ptp4l1390-21diskstats08:30:151
119591140,1ptp4l11880-21ps10:50:191
119591140,0ptp4l32631-21apt-get11:30:120
119591140,0ptp4l29711-21ls08:20:230
119591140,0ptp4l0-21swapper/211:55:222
119591140,0ptp4l0-21swapper/210:30:212
119591140,0ptp4l0-21swapper/112:30:151
119591140,0ptp4l0-21swapper/112:15:121
119591140,0ptp4l0-21swapper/112:00:241
119591140,0ptp4l0-21swapper/111:45:221
119591140,0ptp4l0-21swapper/111:05:161
119591140,0ptp4l0-21swapper/111:00:201
119591140,0ptp4l0-21swapper/110:45:061
119591140,0ptp4l0-21swapper/110:40:151
119591140,0ptp4l0-21swapper/110:20:241
119591140,0ptp4l0-21swapper/109:55:221
119591140,0ptp4l0-21swapper/109:45:161
119591140,0ptp4l0-21swapper/109:30:161
119591140,0ptp4l0-21swapper/109:15:151
119591140,0ptp4l0-21swapper/109:05:181
119591140,0ptp4l0-21swapper/109:04:451
119591140,0ptp4l0-21swapper/108:55:221
119591140,0ptp4l0-21swapper/108:50:181
119591140,0ptp4l0-21swapper/108:40:231
119591140,0ptp4l0-21swapper/108:20:021
119591140,0ptp4l0-21swapper/107:45:151
119591140,0ptp4l0-21swapper/107:35:161
119591140,0ptp4l0-21swapper/107:30:221
119591140,0ptp4l0-21swapper/107:15:031
119591140,0ptp4l0-21swapper/012:10:180
119591140,0ptp4l0-21swapper/012:05:180
119591140,0ptp4l0-21swapper/011:55:170
119591140,0ptp4l0-21swapper/011:35:230
119591140,0ptp4l0-21swapper/011:05:220
119591140,0ptp4l0-21swapper/010:35:150
119591140,0ptp4l0-21swapper/010:25:030
119591140,0ptp4l0-21swapper/010:10:180
119591140,0ptp4l0-21swapper/009:45:180
119591140,0ptp4l0-21swapper/009:30:160
119591140,0ptp4l0-21swapper/009:20:170
119591140,0ptp4l0-21swapper/009:15:200
119591140,0ptp4l0-21swapper/009:10:220
119591140,0ptp4l0-21swapper/009:05:210
119591140,0ptp4l0-21swapper/008:55:120
119591140,0ptp4l0-21swapper/008:10:150
119591140,0ptp4l0-21swapper/008:05:170
119591140,0ptp4l0-21swapper/007:55:220
119591140,0ptp4l0-21swapper/007:40:190
119591130,0ptp4l0-21swapper/211:05:182
119591130,0ptp4l0-21swapper/210:55:192
119591130,0ptp4l0-21swapper/210:35:182
119591130,0ptp4l0-21swapper/210:05:202
119591130,0ptp4l0-21swapper/209:40:222
119591130,0ptp4l0-21swapper/208:55:152
119591130,0ptp4l0-21swapper/208:50:132
119591130,0ptp4l0-21swapper/208:40:192
119591130,0ptp4l0-21swapper/208:35:232
119591130,0ptp4l0-21swapper/208:20:212
119591130,0ptp4l0-21swapper/208:10:132
119591130,0ptp4l0-21swapper/207:45:162
119591130,0ptp4l0-21swapper/112:20:131
119591130,0ptp4l0-21swapper/112:20:131
119591130,0ptp4l0-21swapper/111:25:121
119591130,0ptp4l0-21swapper/111:20:141
119591130,0ptp4l0-21swapper/110:25:131
119591130,0ptp4l0-21swapper/109:50:141
119591130,0ptp4l0-21swapper/108:15:141
119591130,0ptp4l0-21swapper/107:50:111
119591130,0ptp4l0-21swapper/107:40:171
119591130,0ptp4l0-21swapper/012:35:150
119591130,0ptp4l0-21swapper/012:30:140
119591130,0ptp4l0-21swapper/012:25:150
119591130,0ptp4l0-21swapper/010:45:140
119591130,0ptp4l0-21swapper/010:20:150
119591130,0ptp4l0-21swapper/010:00:130
119591130,0ptp4l0-21swapper/008:30:140
119591130,0ptp4l0-21swapper/008:00:130
119591130,0ptp4l0-21swapper/007:35:150
119591130,0ptp4l0-21swapper/007:30:160
119591130,0ptp4l0-21swapper/007:25:010
119591120,0ptp4l0-21swapper/207:50:152
119591110,0ptp4l0-21swapper/212:04:192
119591110,0ptp4l0-21swapper/209:20:112
119591110,0ptp4l0-21swapper/207:25:172
102782110,0sleep30-21swapper/309:45:223
2229899107,2cyclictest20409-21tail10:05:193
2229899101,5cyclictest9086-21apt-get08:45:123
119591100,0ptp4l6119-21sshd07:37:192
119591100,0ptp4l0-21swapper/212:34:422
119591100,0ptp4l0-21swapper/209:25:252
119591100,0ptp4l0-21swapper/208:48:182
222989997,1cyclictest6177-21taskset07:38:043
222989997,1cyclictest5841-21taskset08:35:523
222989997,1cyclictest5264-21chrt10:38:073
222989997,1cyclictest3585-21tr12:35:173
222989997,1cyclictest32041-21chrt11:25:433
222989997,1cyclictest25536-21sed11:15:173
222989997,1cyclictest25042-21expr10:15:123
222989997,1cyclictest24168-21timerwakeupswit07:10:223
222989997,1cyclictest20638-21mii-tool08:05:153
222989997,1cyclictest164162sleep308:55:293
222989996,2cyclictest28207-21tr10:20:183
222989990,8cyclictest28439-21cat12:20:173
222989990,8cyclictest28439-21cat12:20:163
222989990,8cyclictest17589-21uniq09:00:163
222979997,1cyclictest30514-21mktemp08:25:022
222979997,1cyclictest17465-21expr09:00:162
222979997,1cyclictest11119-21seq11:50:132
11959190,1ptp4l0-21swapper/208:15:262
11959190,0ptp4l22293-21cyclictest10:40:322
11959190,0ptp4l0-21swapper/212:39:492
11959190,0ptp4l0-21swapper/212:25:472
11959190,0ptp4l0-21swapper/212:18:522
11959190,0ptp4l0-21swapper/212:14:412
11959190,0ptp4l0-21swapper/212:05:522
11959190,0ptp4l0-21swapper/211:41:182
11959190,0ptp4l0-21swapper/211:30:142
11959190,0ptp4l0-21swapper/211:27:122
11959190,0ptp4l0-21swapper/211:16:022
11959190,0ptp4l0-21swapper/211:11:222
11959190,0ptp4l0-21swapper/211:01:042
11959190,0ptp4l0-21swapper/210:50:572
11959190,0ptp4l0-21swapper/210:47:112
11959190,0ptp4l0-21swapper/210:26:572
11959190,0ptp4l0-21swapper/210:23:002
11959190,0ptp4l0-21swapper/210:15:252
11959190,0ptp4l0-21swapper/210:11:332
11959190,0ptp4l0-21swapper/210:02:112
11959190,0ptp4l0-21swapper/209:57:232
11959190,0ptp4l0-21swapper/209:51:152
11959190,0ptp4l0-21swapper/209:46:052
11959190,0ptp4l0-21swapper/209:39:162
11959190,0ptp4l0-21swapper/209:30:122
11959190,0ptp4l0-21swapper/209:17:222
11959190,0ptp4l0-21swapper/209:10:482
11959190,0ptp4l0-21swapper/208:32:342
11959190,0ptp4l0-21swapper/208:06:132
11959190,0ptp4l0-21swapper/208:01:162
11959190,0ptp4l0-21swapper/207:55:342
11959190,0ptp4l0-21swapper/207:31:382
11959190,0ptp4l0-21swapper/207:21:052
11959190,0ptp4l0-21swapper/207:15:442
11959190,0ptp4l0-21swapper/207:12:462
222989986,1cyclictest981-21cut12:30:173
222989986,1cyclictest9716-21ntp_states10:45:193
222989986,1cyclictest8666-21chrt07:40:473
222989986,1cyclictest7585-21latency08:40:173
222989986,1cyclictest6250-21expr09:40:123
222989986,1cyclictest5912-21tr10:40:163
222989986,1cyclictest5833-21cat11:40:133
222989986,1cyclictest4398-21load09:35:183
222989986,1cyclictest32239-21taskset10:26:123
222989986,1cyclictest31666-21sed12:25:243
222989986,1cyclictest31518-21cat08:25:153
222989986,1cyclictest3134-21cat07:30:243
222989986,1cyclictest312-21basename10:30:113
222989986,1cyclictest31171-21hostname07:25:133
222989986,1cyclictest3047-21tr11:35:143
222989986,1cyclictest30337-21sh09:25:133
222989986,1cyclictest29766-21ntp_kernel_pll_07:20:203
222989986,1cyclictest29310-21sed08:20:203
222989986,1cyclictest27344-21tr11:20:133
222989986,1cyclictest26926-21cat07:15:173
222989986,1cyclictest26665-21chrt12:19:483
222989986,1cyclictest26241-21cut08:15:153
222989986,1cyclictest25594-21grep09:15:153
222989986,1cyclictest2483-21tail09:30:243
222989986,1cyclictest24011-21chrt10:13:173
222989986,1cyclictest22974-21df08:10:133
222989986,1cyclictest22825-21diskstats09:10:143
222989986,1cyclictest22090-21cat11:10:143
222989986,1cyclictest20825-21snmp_o5powerctl11:05:223
222989986,1cyclictest20757-21cut09:05:193
222989986,1cyclictest20117-21chrt12:05:173
222989986,1cyclictest17994-21uname10:00:203
222989986,1cyclictest17912-21cat12:00:233
222989986,1cyclictest17243-21basename08:00:143
222989986,1cyclictest16477-21chrt11:00:123
222989986,1cyclictest15822-21ls07:55:173
222989986,1cyclictest13952-21expr10:55:143
222989986,1cyclictest13912-21tail09:55:143
222989986,1cyclictest13869-21expr11:55:153
222989986,1cyclictest1339-21expr08:30:133
222989986,1cyclictest12945-21grep10:50:243
222989986,1cyclictest12894-21cat09:50:233
222989986,1cyclictest12386-21cut08:50:163
222989986,1cyclictest12283-21cut11:50:193
222989986,1cyclictest11911-21cut07:50:113
222989986,1cyclictest11490-21seq07:48:063
222989986,1cyclictest104372sleep311:48:243
222979986,1cyclictest27327-21tr11:20:132
222989975,1cyclictest29241-21taskset09:20:203
222989975,1cyclictest21689-21cut12:10:163
222989975,1cyclictest1076-21interrupts11:30:163
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional