You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-27 - 22:12

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot5s.osadl.org (updated Mon Jul 27, 2026 12:44:20)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
19830992624,1cyclictest0-21swapper/310:00:013
19830992523,1cyclictest0-21swapper/311:14:303
1983099250,1cyclictest30644-21mailstats11:18:253
1982699250,1cyclictest1888-21munin-run07:40:002
19818992523,2cyclictest0-21swapper/009:59:070
1981899250,24cyclictest0-21swapper/011:32:390
19830992423,1cyclictest0-21swapper/310:40:353
19830992421,2cyclictest18610-21/usr/sbin/munin09:43:173
1983099240,23cyclictest32366-21cat09:55:013
1983099240,23cyclictest13174-21diskmemload12:10:553
1983099240,23cyclictest13174-21diskmemload09:23:083
1983099240,23cyclictest0-21swapper/311:04:093
1983099240,0cyclictest0-21swapper/309:30:273
19826992422,1cyclictest13174-21diskmemload10:48:162
19826992422,1cyclictest0-21swapper/211:27:192
19826992420,3cyclictest0-21swapper/212:11:512
1982699240,2cyclictest23131-21sh10:15:232
1982699240,23cyclictest378-21ssh10:52:582
1982699240,23cyclictest31184-21ssh12:17:102
1982699240,23cyclictest13174-21diskmemload09:25:562
1982699240,23cyclictest0-21swapper/211:32:322
1982699240,0cyclictest20442-21ssh10:41:212
19822992423,1cyclictest0-21swapper/109:28:531
19822992423,1cyclictest0-21swapper/109:22:531
1982299240,23cyclictest14258-21df11:33:161
1982299240,23cyclictest0-21swapper/112:28:301
1982299240,23cyclictest0-21swapper/111:19:241
1982299240,0cyclictest13174-21diskmemload10:31:551
1982299240,0cyclictest0-21swapper/110:09:041
19818992423,1cyclictest0-21swapper/010:06:100
19818992421,2cyclictest0-21swapper/010:48:170
1981899240,23cyclictest0-21swapper/010:23:120
1981899240,1cyclictest24659-21apt-get09:20:020
1981899240,1cyclictest13991-21ssh12:01:420
1981899240,0cyclictest0-21swapper/012:20:420
1981899240,0cyclictest0-21swapper/009:13:200
19830992323,0cyclictest13174-21diskmemload11:43:433
19830992323,0cyclictest0-21swapper/312:35:323
19830992323,0cyclictest0-21swapper/312:21:223
19830992323,0cyclictest0-21swapper/311:20:383
19830992323,0cyclictest0-21swapper/310:50:063
19830992323,0cyclictest0-21swapper/310:30:073
19830992321,1cyclictest0-21swapper/311:55:033
19830992321,1cyclictest0-21swapper/311:35:123
19830992320,2cyclictest2028-21sh11:50:403
1983099230,2cyclictest23296-21sh10:15:363
1983099230,2cyclictest1138-21wc08:45:003
1983099230,23cyclictest0-21swapper/312:25:403
1983099230,23cyclictest0-21swapper/310:26:393
1983099230,22cyclictest3363-21ssh09:29:133
1983099230,22cyclictest30897-21apt-get10:23:123
1983099230,22cyclictest24685-21perf09:20:003
1983099230,22cyclictest18809-21cron10:40:013
1983099230,22cyclictest1260-21cron11:50:003
1983099230,22cyclictest0-21swapper/312:31:123
1983099230,22cyclictest0-21swapper/311:25:573
1983099230,0cyclictest0-21swapper/312:17:593
19826992323,0cyclictest13174-21diskmemload10:56:522
19826992323,0cyclictest13174-21diskmemload09:30:152
19826992323,0cyclictest0-21swapper/212:36:342
19826992323,0cyclictest0-21swapper/212:29:502
19826992323,0cyclictest0-21swapper/211:58:242
19826992323,0cyclictest0-21swapper/211:49:292
19826992323,0cyclictest0-21swapper/210:38:022
19826992321,1cyclictest0-21swapper/211:35:182
19826992321,1cyclictest0-21swapper/209:35:342
19826992320,2cyclictest26962-21cron07:25:012
19826992320,2cyclictest26212-21ssh09:21:162
19826992320,2cyclictest2337-21ssh11:51:122
19826992320,2cyclictest19488-21ssh10:13:132
1982699230,23cyclictest13174-21diskmemload12:35:002
1982699230,23cyclictest0-21swapper/210:25:592
1982699230,23cyclictest0-21swapper/210:06:382
1982699230,22cyclictest8128-21ssh10:31:032
1982699230,22cyclictest28827-21ssh10:20:232
1982699230,22cyclictest13174-21diskmemload12:21:162
1982699230,22cyclictest13174-21diskmemload11:04:362
1982699230,22cyclictest12837-21ssh12:00:072
1982699230,0cyclictest0-21swapper/211:14:032
19822992323,0cyclictest2232-21ssh11:51:031
19822992323,0cyclictest13174-21diskmemload09:46:191
19822992323,0cyclictest0-21swapper/112:20:211
19822992323,0cyclictest0-21swapper/111:04:011
19822992323,0cyclictest0-21swapper/110:50:361
19822992323,0cyclictest0-21swapper/110:24:281
19822992323,0cyclictest0-21swapper/109:59:531
19822992323,0cyclictest0-21swapper/109:10:061
19822992320,2cyclictest29695-21df_inode09:53:131
19822992320,2cyclictest22728-21ssh09:18:191
1982299230,23cyclictest13174-21diskmemload10:39:001
1982299230,23cyclictest0-21swapper/110:43:591
1982299230,23cyclictest0-21swapper/110:11:231
1982299230,22cyclictest6286-21ssh09:32:511
1982299230,22cyclictest3310-21rm10:27:101
1982299230,22cyclictest32082-21apt-get12:18:161
1982299230,22cyclictest22053-21apt-get08:23:131
1982299230,22cyclictest11892-21ssh11:59:091
1982299230,22cyclictest10026-21ssh09:35:121
1982299230,22cyclictest0-21swapper/107:50:021
1982299230,1cyclictest13174-21diskmemload12:36:411
1982299230,0cyclictest13174-21diskmemload12:31:351
1982299230,0cyclictest0-21swapper/112:09:121
1982299230,0cyclictest0-21swapper/111:11:071
1982299230,0cyclictest0-21swapper/109:43:571
19818992323,0cyclictest0-21swapper/011:46:540
19818992323,0cyclictest0-21swapper/007:38:150
19818992321,1cyclictest6485-21ssh09:33:050
19818992321,1cyclictest0-21swapper/010:34:060
19818992321,1cyclictest0-21swapper/009:26:190
19818992320,2cyclictest9227-21ssh11:57:510
1981899230,2cyclictest15483-21grep11:05:000
1981899230,23cyclictest0-21swapper/012:34:530
1981899230,23cyclictest0-21swapper/012:25:510
1981899230,23cyclictest0-21swapper/011:54:110
1981899230,23cyclictest0-21swapper/010:17:290
1981899230,22cyclictest27078-21ssh11:15:170
1981899230,22cyclictest13174-21diskmemload10:14:010
1981899230,22cyclictest13174-21diskmemload09:42:130
1981899230,22cyclictest0-21swapper/012:17:430
1981899230,22cyclictest0-21swapper/010:04:080
1981899230,22cyclictest0-21swapper/009:45:290
1981899230,1cyclictest0-21swapper/012:05:280
1981899230,1cyclictest0-21swapper/011:29:220
1981899230,0cyclictest0-21swapper/011:36:070
19830992222,0cyclictest0-21swapper/310:06:243
19830992221,1cyclictest0-21swapper/312:04:163
19830992221,1cyclictest0-21swapper/310:10:053
19830992220,2cyclictest13174-21diskmemload10:45:403
1983099220,21cyclictest0-21swapper/309:48:123
1983099220,21cyclictest0-21swapper/309:35:273
1983099220,21cyclictest0-21swapper/309:10:493
1983099220,1cyclictest4590-21sh10:55:183
1983099220,1cyclictest20742-21sh12:08:143
1983099220,0cyclictest13174-21diskmemload11:30:253
1983099220,0cyclictest13174-21diskmemload11:06:063
19826992222,0cyclictest0-21swapper/211:21:442
19826992222,0cyclictest0-21swapper/209:40:142
19826992222,0cyclictest0-21swapper/209:10:122
19826992221,1cyclictest11298-21apt-get09:08:152
19826992220,1cyclictest0-21swapper/211:15:062
19826992220,1cyclictest0-21swapper/210:00:192
19826992220,1cyclictest0-21swapper/209:45:572
1982699220,22cyclictest0-21swapper/211:41:322
1982699220,22cyclictest0-21swapper/209:50:582
1982699220,21cyclictest23953-21latency_hist08:25:012
1982699220,21cyclictest19932-21ssh09:15:492
1982699220,21cyclictest1359-21ssh09:56:352
1982699220,21cyclictest0-21swapper/207:53:122
1982699220,1cyclictest19936-21ssh12:07:042
19822992222,0cyclictest0-21swapper/112:10:271
19822992222,0cyclictest0-21swapper/112:01:011
19822992222,0cyclictest0-21swapper/111:29:501
19822992220,1cyclictest31152-21grep08:40:001
1982299220,22cyclictest0-21swapper/111:35:341
1982299220,21cyclictest8906-21apt-get09:03:161
1982299220,21cyclictest6435-21apt-get08:58:151
1982299220,21cyclictest4381-21apt-get10:55:021
1982299220,21cyclictest28748-21ssh11:45:351
1982299220,21cyclictest27494-21apt-get07:28:131
1982299220,21cyclictest0-21swapper/111:20:091
1982299220,21cyclictest0-21swapper/108:18:121
1982299220,0cyclictest0-21swapper/111:07:021
19818992222,0cyclictest13174-21diskmemload11:10:480
19818992222,0cyclictest0-21swapper/010:35:020
19818992222,0cyclictest0-21swapper/009:52:040
19818992221,1cyclictest14839-21apt-get08:08:130
19818992221,1cyclictest14737-21ssh09:39:110
19818992221,0cyclictest0-21swapper/008:48:160
19818992220,1cyclictest0-21swapper/012:10:060
1981899220,21cyclictest13174-21diskmemload10:56:320
1981899220,21cyclictest0-21swapper/010:29:520
1981899220,21cyclictest0-21swapper/009:05:010
1981899220,1cyclictest16243-21ssh11:05:470
1981899220,1cyclictest13174-21diskmemload10:50:010
1981899220,1cyclictest0-21swapper/009:15:140
1981899220,0cyclictest0-21swapper/011:42:440
1981899220,0cyclictest0-21swapper/010:40:220
19830992120,1cyclictest606-21dbus-daemon08:40:003
19830992119,1cyclictest0-21swapper/310:01:513
19830992119,1cyclictest0-21swapper/307:45:003
1983099210,21cyclictest0-21swapper/307:48:163
1983099210,20cyclictest6685-21apt-get07:50:023
1983099210,20cyclictest25099-21apt-get07:23:133
1983099210,20cyclictest10030-21apt-get07:58:133
1983099210,20cyclictest0-21swapper/308:33:143
1983099210,0cyclictest0-21swapper/308:58:153
19826992120,1cyclictest0-21swapper/208:33:132
19826992120,0cyclictest0-21swapper/208:38:142
19826992119,1cyclictest0-21swapper/207:35:012
1982699210,20cyclictest2399-21apt-get07:43:142
1982699210,20cyclictest1106-21idleruntime-cro08:45:002
1982699210,20cyclictest0-21swapper/207:13:132
1982299210,20cyclictest0-21swapper/108:33:131
1982299210,0cyclictest0-21swapper/111:40:491
19818992121,0cyclictest0-21swapper/012:35:150
19818992119,1cyclictest26844-21apt-get08:33:130
1981899210,20cyclictest11298-21apt-get09:08:150
1981899210,0cyclictest0-21swapper/008:58:150
19830992020,0cyclictest0-21swapper/308:13:153
1983099200,0cyclictest0-21swapper/307:33:143
19826992020,0cyclictest0-21swapper/208:28:142
19826992020,0cyclictest0-21swapper/208:08:132
19826992020,0cyclictest0-21swapper/207:58:132
19826992020,0cyclictest0-21swapper/207:48:162
19826992020,0cyclictest0-21swapper/207:18:152
19822992020,0cyclictest4795-21apt-get07:48:161
19822992020,0cyclictest0-21swapper/109:08:151
19822992020,0cyclictest0-21swapper/108:48:161
1982299200,0cyclictest31659-21apt-get08:43:151
1982299200,0cyclictest0-21swapper/107:58:131
19818992018,1cyclictest0-21swapper/008:18:120
19830991919,0cyclictest0-21swapper/308:48:173
19830991917,1cyclictest0-21swapper/308:53:143
19826991919,0cyclictest0-21swapper/208:13:152
19822991919,0cyclictest32392-21apt-get07:38:151
19822991919,0cyclictest0-21swapper/108:53:141
19822991919,0cyclictest0-21swapper/107:23:131
19822991916,2cyclictest24611-21idleruntime-cro07:20:011
19818991919,0cyclictest7582-21apt-get07:53:120
19818991919,0cyclictest0-21swapper/008:30:000
19818991919,0cyclictest0-21swapper/007:48:160
19818991919,0cyclictest0-21swapper/007:18:150
19818991917,1cyclictest5917-21sh08:55:010
19830991818,0cyclictest0-21swapper/307:38:153
19830991816,1cyclictest24599-21munin-run07:20:013
19826991818,0cyclictest0-21swapper/207:28:132
19822991818,0cyclictest17235-21apt-get08:13:151
19818991818,0cyclictest0-21swapper/007:23:130
1981899180,17cyclictest12446-21apt-get08:03:140
19830991717,0cyclictest0-21swapper/308:28:143
19830991717,0cyclictest0-21swapper/308:18:123
19826991717,0cyclictest4038-21apt-get08:53:132
1981899174,7cyclictest23997-21latency_hist08:25:010
19818991717,0cyclictest0-21swapper/008:38:140
1981899170,16cyclictest1162-21cat08:45:000
19830991616,0cyclictest0-21swapper/307:28:133
19830991615,0cyclictest0-21swapper/308:08:133
1983099160,2cyclictest13892-21sed08:03:233
19826991616,0cyclictest0-21swapper/208:03:132
1982699160,15cyclictest9951-21ntp_states09:03:222
19822991616,0cyclictest24448-21apt-get08:28:141
19822991616,0cyclictest0-21swapper/108:03:141
1982299160,15cyclictest16918-21munin-run08:10:011
19818991615,1cyclictest0-21swapper/007:13:130
1981899160,15cyclictest783-21snmpd08:12:140
19830991515,0cyclictest0-21swapper/309:03:163
19826991515,0cyclictest19627-21apt-get08:18:122
1982299150,1cyclictest783-21snmpd07:10:211
19818991515,0cyclictest0-21swapper/007:58:130
1981899150,5cyclictest0-21swapper/007:28:130
19830991414,0cyclictest0-21swapper/308:20:173
19830991414,0cyclictest0-21swapper/307:11:203
1983099140,14cyclictest0-21swapper/309:07:063
19826991414,0cyclictest0-21swapper/208:46:012
1982699140,14cyclictest0-21swapper/208:55:162
19822991414,0cyclictest0-21swapper/107:40:491
1981899140,14cyclictest0-21swapper/007:40:390
1981899140,14cyclictest0-21swapper/007:30:220
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional