You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-02 - 19:17

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #9, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Kontron
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack9slot3s.osadl.org (updated Sun Aug 02, 2026 12:44:51)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
119591720,50ptp4l0-21swapper/007:09:130
3233525647,7sleep30-21swapper/307:09:003
119591560,33ptp4l0-21swapper/107:05:241
3239125346,5sleep20-21swapper/207:09:422
60032520,0sleep10-21swapper/112:20:191
119591240,0ptp4l0-21swapper/111:50:271
119591210,1ptp4l25667-21if_enp2s007:55:200
119591190,0ptp4l0-21swapper/107:15:251
119591190,0ptp4l0-21swapper/010:05:220
119591180,0ptp4l0-21swapper/112:30:151
119591180,0ptp4l0-21swapper/112:10:211
119591170,0ptp4l0-21swapper/111:45:201
119591170,0ptp4l0-21swapper/109:45:021
119591170,0ptp4l0-21swapper/010:10:240
119591170,0ptp4l0-21swapper/009:25:220
119591170,0ptp4l0-21swapper/009:20:180
119591160,1ptp4l6762-21snmp_o5powerctl11:20:211
119591160,1ptp4l30064-21apt-get09:05:140
119591160,1ptp4l28276-21diskstats08:00:171
119591160,1ptp4l24218-21apt-get10:55:131
119591160,1ptp4l23941-21snmp_o5powerctl07:50:241
119591160,1ptp4l23622-21snmp_o5powerctl09:50:261
119591160,1ptp4l21128-21snmp_o5powerctl08:45:200
119591160,1ptp4l20969-21snmp_o5powerctl09:45:230
119591160,1ptp4l17366-21snmp_o5powerctl11:40:231
119591160,1ptp4l13338-21snmp_o5powerctl07:30:220
119591160,0ptp4l0-21swapper/011:20:160
119591150,2ptp4l9480-21df07:25:141
119591150,1ptp4l8283-21fschecks_time11:25:151
119591150,1ptp4l7668-21snmp_o5powerctl08:20:241
119591150,1ptp4l6391-21snmp_o5powerctl12:20:230
119591150,1ptp4l576-21df10:10:141
119591150,1ptp4l3927-21cat12:15:251
119591150,1ptp4l31276-21ls09:05:191
119591150,1ptp4l30967-21users12:05:241
119591150,1ptp4l27519-21memory12:00:191
119591150,1ptp4l27006-21perf10:00:010
119591150,1ptp4l25522-21ls11:55:240
119591150,1ptp4l2524-21df_inode12:15:160
119591150,1ptp4l24906-21hddtemp_smartct10:55:160
119591150,1ptp4l2394-21/usr/sbin/munin11:15:200
119591150,1ptp4l23329-21ntp_states09:50:230
119591150,1ptp4l2129-21ls09:10:240
119591150,1ptp4l21289-21smartctl07:45:220
119591150,1ptp4l20383-21snmp_o5powerctl10:45:221
119591150,1ptp4l17816-21memory08:40:181
119591150,1ptp4l14513-21irqstats10:35:181
119591150,1ptp4l14414-21diskstats08:35:161
119591150,1ptp4l12796-21snmp_o5powerctl09:30:230
119591150,1ptp4l12424-21snmp_o5powerctl10:30:220
119591150,1ptp4l12052-21snmp_o5powerctl11:30:220
119591150,0ptp4l0-21swapper/212:05:222
119591150,0ptp4l0-21swapper/209:05:232
119591150,0ptp4l0-21swapper/112:35:021
119591150,0ptp4l0-21swapper/112:35:021
119591150,0ptp4l0-21swapper/112:25:141
119591150,0ptp4l0-21swapper/111:55:131
119591150,0ptp4l0-21swapper/111:10:271
119591150,0ptp4l0-21swapper/111:00:131
119591150,0ptp4l0-21swapper/109:40:131
119591150,0ptp4l0-21swapper/109:00:131
119591150,0ptp4l0-21swapper/108:10:221
119591150,0ptp4l0-21swapper/010:40:120
119591150,0ptp4l0-21swapper/010:20:140
119591150,0ptp4l0-21swapper/009:40:160
119591150,0ptp4l0-21swapper/008:05:240
119591140,1ptp4l919-21ps12:10:220
119591140,1ptp4l6433-21expr08:20:160
119591140,1ptp4l4055-21if_enp0s31f608:15:161
119591140,1ptp4l22293-21grep08:50:140
119591140,1ptp4l20262-21kworker/0:109:15:120
119591140,1ptp4l18604-21grep08:40:240
119591140,1ptp4l10312-21smartctl08:25:241
119591140,0ptp4l14070-21ls12:35:160
119591140,0ptp4l14070-21ls12:35:160
119591140,0ptp4l0-21swapper/211:40:212
119591140,0ptp4l0-21swapper/211:25:232
119591140,0ptp4l0-21swapper/211:05:182
119591140,0ptp4l0-21swapper/111:30:241
119591140,0ptp4l0-21swapper/111:17:311
119591140,0ptp4l0-21swapper/111:05:191
119591140,0ptp4l0-21swapper/110:50:161
119591140,0ptp4l0-21swapper/110:40:221
119591140,0ptp4l0-21swapper/110:30:221
119591140,0ptp4l0-21swapper/110:25:211
119591140,0ptp4l0-21swapper/110:15:131
119591140,0ptp4l0-21swapper/110:05:161
119591140,0ptp4l0-21swapper/110:00:191
119591140,0ptp4l0-21swapper/109:55:191
119591140,0ptp4l0-21swapper/109:35:181
119591140,0ptp4l0-21swapper/109:30:021
119591140,0ptp4l0-21swapper/109:25:161
119591140,0ptp4l0-21swapper/109:20:211
119591140,0ptp4l0-21swapper/108:50:181
119591140,0ptp4l0-21swapper/108:45:211
119591140,0ptp4l0-21swapper/108:30:241
119591140,0ptp4l0-21swapper/108:08:161
119591140,0ptp4l0-21swapper/107:55:221
119591140,0ptp4l0-21swapper/107:45:161
119591140,0ptp4l0-21swapper/107:35:161
119591140,0ptp4l0-21swapper/107:30:141
119591140,0ptp4l0-21swapper/107:20:241
119591140,0ptp4l0-21swapper/012:30:180
119591140,0ptp4l0-21swapper/012:25:170
119591140,0ptp4l0-21swapper/012:05:160
119591140,0ptp4l0-21swapper/012:00:240
119591140,0ptp4l0-21swapper/011:35:190
119591140,0ptp4l0-21swapper/011:05:010
119591140,0ptp4l0-21swapper/010:50:140
119591140,0ptp4l0-21swapper/010:15:240
119591140,0ptp4l0-21swapper/008:35:180
119591140,0ptp4l0-21swapper/008:30:190
119591140,0ptp4l0-21swapper/008:25:250
119591140,0ptp4l0-21swapper/008:10:140
119591140,0ptp4l0-21swapper/008:00:020
119591140,0ptp4l0-21swapper/007:40:210
119591140,0ptp4l0-21swapper/007:35:220
119591140,0ptp4l0-21swapper/007:20:220
119591140,0ptp4l0-21swapper/007:16:410
119591130,1ptp4l24962-21tr08:55:160
119591130,0ptp4l1820-21snmp_o5powerctl10:10:222
119591130,0ptp4l0-21swapper/212:20:182
119591130,0ptp4l0-21swapper/211:45:162
119591130,0ptp4l0-21swapper/210:40:242
119591130,0ptp4l0-21swapper/210:35:242
119591130,0ptp4l0-21swapper/210:20:252
119591130,0ptp4l0-21swapper/209:50:242
119591130,0ptp4l0-21swapper/209:30:182
119591130,0ptp4l0-21swapper/209:20:232
119591130,0ptp4l0-21swapper/209:10:172
119591130,0ptp4l0-21swapper/207:41:182
119591130,0ptp4l0-21swapper/207:25:142
119591130,0ptp4l0-21swapper/207:10:152
119591130,0ptp4l0-21swapper/111:35:141
119591130,0ptp4l0-21swapper/110:20:151
119591130,0ptp4l0-21swapper/109:15:111
119591130,0ptp4l0-21swapper/109:10:181
119591130,0ptp4l0-21swapper/108:55:181
119591130,0ptp4l0-21swapper/107:40:011
119591130,0ptp4l0-21swapper/107:10:021
119591130,0ptp4l0-21swapper/011:50:010
119591130,0ptp4l0-21swapper/011:45:140
119591130,0ptp4l0-21swapper/011:40:140
119591130,0ptp4l0-21swapper/011:25:140
119591130,0ptp4l0-21swapper/011:10:150
119591130,0ptp4l0-21swapper/011:05:140
119591130,0ptp4l0-21swapper/010:45:140
119591130,0ptp4l0-21swapper/010:35:150
119591130,0ptp4l0-21swapper/010:25:140
119591130,0ptp4l0-21swapper/010:00:140
119591130,0ptp4l0-21swapper/009:35:140
119591130,0ptp4l0-21swapper/009:00:140
119591130,0ptp4l0-21swapper/008:15:140
119591130,0ptp4l0-21swapper/007:50:160
119591130,0ptp4l0-21swapper/007:25:160
119591130,0ptp4l0-21swapper/007:10:140
3267599125,2cyclictest119591ptp4l09:43:352
119591120,0ptp4l0-21swapper/211:20:022
119591120,0ptp4l0-21swapper/210:50:262
119591120,0ptp4l0-21swapper/209:15:222
5872113,0sleep3803-21gltestperf10:10:153
119591110,0ptp4l0-21swapper/212:28:352
119591110,0ptp4l0-21swapper/210:27:072
119591110,0ptp4l0-21swapper/208:29:572
3267599102,4cyclictest0-21swapper/210:15:132
119591100,0ptp4l0-21swapper/308:05:223
119591100,0ptp4l0-21swapper/211:02:352
119591100,0ptp4l0-21swapper/209:28:162
119591100,0ptp4l0-21swapper/208:33:342
119591100,0ptp4l0-21swapper/207:46:352
326769997,1cyclictest3229-21expr10:15:143
326769997,1cyclictest3147-21basename11:15:173
326769997,1cyclictest29976-21cut10:05:123
326769997,1cyclictest27754-21chrt08:00:033
326769997,1cyclictest27155-21cat09:00:013
326769997,1cyclictest20684-21taskset11:49:263
326769997,1cyclictest186322sleep309:42:323
326769997,1cyclictest16554-21seq07:38:103
326769997,1cyclictest14554-21expr10:35:183
326769997,1cyclictest13851-21taskset07:32:243
326769997,1cyclictest12025-21vmstat12:30:253
326759997,1cyclictest521-21cat11:10:172
326759997,1cyclictest515-21cat08:10:012
326759997,1cyclictest2126-21tail08:10:192
326759997,1cyclictest15072-21tail09:35:182
326759997,1cyclictest14280-21grep11:35:192
326759990,8cyclictest29893-21basename10:05:122
326759990,5cyclictest0-21swapper/208:20:142
11959190,1ptp4l41-21ksoftirqd/312:05:453
11959190,0ptp4l41-21ksoftirqd/307:23:133
11959190,0ptp4l0-21swapper/212:36:232
11959190,0ptp4l0-21swapper/212:36:232
11959190,0ptp4l0-21swapper/212:32:572
11959190,0ptp4l0-21swapper/212:15:072
11959190,0ptp4l0-21swapper/212:11:312
11959190,0ptp4l0-21swapper/212:02:252
11959190,0ptp4l0-21swapper/211:55:262
11959190,0ptp4l0-21swapper/211:52:352
11959190,0ptp4l0-21swapper/211:30:422
11959190,0ptp4l0-21swapper/211:19:212
11959190,0ptp4l0-21swapper/210:55:442
11959190,0ptp4l0-21swapper/210:30:362
11959190,0ptp4l0-21swapper/210:02:102
11959190,0ptp4l0-21swapper/209:55:382
11959190,0ptp4l0-21swapper/209:46:262
11959190,0ptp4l0-21swapper/209:00:122
11959190,0ptp4l0-21swapper/208:58:092
11959190,0ptp4l0-21swapper/208:51:542
11959190,0ptp4l0-21swapper/208:46:422
11959190,0ptp4l0-21swapper/208:41:332
11959190,0ptp4l0-21swapper/208:35:052
11959190,0ptp4l0-21swapper/208:16:142
11959190,0ptp4l0-21swapper/208:02:102
11959190,0ptp4l0-21swapper/207:55:362
11959190,0ptp4l0-21swapper/207:51:232
11959190,0ptp4l0-21swapper/207:39:322
11959190,0ptp4l0-21swapper/207:31:482
11959190,0ptp4l0-21swapper/207:22:102
11959190,0ptp4l0-21swapper/207:15:312
326769986,1cyclictest9721-21grep11:25:243
326769986,1cyclictest9156-21wc12:25:253
326769986,1cyclictest8948-21cat10:25:173
326769986,1cyclictest8606-21taskset08:25:083
326769986,1cyclictest8515-21tr09:25:143
326769986,1cyclictest7869-21sed08:20:253
326769986,1cyclictest6162-21cut09:20:163
326769986,1cyclictest5463-21bc10:20:143
326769986,1cyclictest5386-21cat11:20:143
326769986,1cyclictest5367-21taskset08:15:323
326769986,1cyclictest4821-21cut12:20:143
326769986,1cyclictest4335-21head07:15:163
326769986,1cyclictest380-21head11:10:163
326769986,1cyclictest3102-21sed12:15:193
326769986,1cyclictest3012-21sh09:15:113
326769986,1cyclictest29503-21chrt11:05:113
326769986,1cyclictest28422-21taskset12:01:353
326769986,1cyclictest28133-21cat11:00:193
326769986,1cyclictest27610-21cat10:00:153
326769986,1cyclictest27446-21sh09:00:133
326769986,1cyclictest26265-21ntpq07:55:223
326769986,1cyclictest25802-21taskset11:57:103
326769986,1cyclictest25108-21tr10:55:183
326769986,1cyclictest245532sleep309:55:053
326769986,1cyclictest24235-21seq08:51:403
326769986,1cyclictest2410-21chrt07:11:233
326769986,1cyclictest23868-21wc07:50:233
326769986,1cyclictest23552sleep309:10:373
326769986,1cyclictest22600-21sed09:50:193
326769986,1cyclictest22310-21sed10:50:193
326769986,1cyclictest21291-21chrt07:45:223
326769986,1cyclictest21038-21aten_r9power_en11:50:163
326769986,1cyclictest20017-21tune2fs08:45:133
326769986,1cyclictest19342-21cut09:45:143
326769986,1cyclictest18675-21chrt10:45:053
326769986,1cyclictest17336-21readlink11:40:233
326769986,1cyclictest17183-21tr07:40:113
326769986,1cyclictest16789-21cat08:40:133
326769986,1cyclictest16583-21cut10:40:143
326769986,1cyclictest15343-21taskset11:39:053
326769986,1cyclictest14137-21expr09:35:143
326769986,1cyclictest138922sleep308:35:013
326769986,1cyclictest13516-21expr12:35:143
326769986,1cyclictest13516-21expr12:35:143
326769986,1cyclictest1329-21grep08:10:153
326769986,1cyclictest1284-21cat12:10:253
326769986,1cyclictest11369-21grep09:30:143
326769986,1cyclictest11283-21basename08:30:133
326769986,1cyclictest11217-21expr10:30:143
326769986,1cyclictest10877-21grep11:30:153
326769986,1cyclictest10512-21tr07:25:203
11959180,0ptp4l0-21swapper/210:46:062
326769975,1cyclictest31647-21rt-features09:05:223
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional