You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2023-01-29 - 03:21

x86 Intel Core i5-6440EQ @2700 MHz, Linux 4.9.47-rt37 (Profile)

Latency plot of system in rack #5, slot #2
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Command line: cyclictest -l100000000 -m -Sp99 -i200 -h400 -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack5slot2.osadl.org (updated Sun Jan 29, 2023 00:44:42)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
266672207176,12sleep10-21swapper/119:06:201
266562183166,12sleep00-21swapper/019:06:110
267652179161,13sleep30-21swapper/319:07:353
2668729881,12sleep20-21swapper/219:06:342
160662510,0sleep10-21swapper/100:05:181
207752440,0sleep10-21swapper/121:48:141
296222430,0sleep10-21swapper/100:33:211
2713199113,4cyclictest29486-21munin-run19:15:000
27962290,0sleep00-21swapper/022:52:080
271319991,4cyclictest7372-21idleruntime-cro23:00:010
271479972,5cyclictest29710-21kworker/3:221:15:343
271479972,5cyclictest29710-21kworker/3:219:55:153
271479972,5cyclictest19770-21kworker/3:123:55:263
271479972,5cyclictest19770-21kworker/3:123:51:143
271479972,5cyclictest19770-21kworker/3:123:46:533
271479972,5cyclictest19770-21kworker/3:123:21:413
271479972,5cyclictest19770-21kworker/3:123:19:163
271479972,5cyclictest19770-21kworker/3:122:57:013
271479972,5cyclictest19770-21kworker/3:122:52:023
271479972,5cyclictest19770-21kworker/3:122:44:183
271479972,5cyclictest19770-21kworker/3:122:34:413
271479972,5cyclictest19770-21kworker/3:122:26:323
271479972,5cyclictest19770-21kworker/3:122:22:303
271479972,5cyclictest19770-21kworker/3:122:06:233
271479972,5cyclictest19770-21kworker/3:121:55:423
271479972,5cyclictest19770-21kworker/3:121:48:583
271479972,5cyclictest19770-21kworker/3:121:40:113
271479972,5cyclictest19770-21kworker/3:121:31:173
271479972,5cyclictest19770-21kworker/3:100:35:563
271479972,5cyclictest19770-21kworker/3:100:29:373
271479972,5cyclictest19770-21kworker/3:100:23:303
271479972,5cyclictest19770-21kworker/3:100:02:343
271479971,6cyclictest19770-21kworker/3:123:44:413
271479971,6cyclictest19770-21kworker/3:123:31:263
271479971,6cyclictest19770-21kworker/3:123:08:543
271479971,6cyclictest19770-21kworker/3:122:36:153
271479971,6cyclictest19770-21kworker/3:100:08:413
271479962,4cyclictest29710-21kworker/3:220:00:193
271479962,4cyclictest29710-21kworker/3:219:45:303
271479962,4cyclictest29710-21kworker/3:219:40:283
271479962,4cyclictest19770-21kworker/3:123:25:093
271479962,4cyclictest19770-21kworker/3:122:45:223
271479962,4cyclictest19770-21kworker/3:100:10:133
271479962,4cyclictest19770-21kworker/3:100:10:123
271479961,5cyclictest29710-21kworker/3:221:25:053
271479961,5cyclictest29710-21kworker/3:221:20:203
271479961,5cyclictest29710-21kworker/3:221:10:543
271479961,5cyclictest29710-21kworker/3:220:55:213
271479961,5cyclictest29710-21kworker/3:220:35:143
271479961,5cyclictest29710-21kworker/3:220:15:283
271479961,5cyclictest19770-21kworker/3:123:35:143
271479961,5cyclictest19770-21kworker/3:123:10:103
271479961,5cyclictest19770-21kworker/3:123:01:453
271479961,5cyclictest19770-21kworker/3:122:15:283
271479961,5cyclictest19770-21kworker/3:122:10:393
271479961,5cyclictest19770-21kworker/3:122:00:193
271479961,5cyclictest19770-21kworker/3:121:50:043
271479961,5cyclictest19770-21kworker/3:121:35:193
271479961,5cyclictest19770-21kworker/3:100:31:033
271479961,5cyclictest19770-21kworker/3:100:15:063
271479960,5cyclictest0-21swapper/319:35:163
271319966,0cyclictest0-21swapper/021:10:160
271479952,3cyclictest29710-21kworker/3:220:46:013
271479952,3cyclictest29710-21kworker/3:220:25:233
271479952,3cyclictest29710-21kworker/3:220:20:033
271479952,3cyclictest29710-21kworker/3:220:05:063
271479952,3cyclictest29710-21kworker/3:219:25:243
271479951,4cyclictest29710-21kworker/3:221:00:323
271479951,4cyclictest29710-21kworker/3:220:40:283
271479951,4cyclictest29710-21kworker/3:220:10:023
271479951,4cyclictest29710-21kworker/3:219:50:283
271479951,4cyclictest29710-21kworker/3:219:20:003
271479950,5cyclictest29710-21kworker/3:220:30:163
271479950,5cyclictest0-21swapper/320:50:033
271439955,0cyclictest0-21swapper/223:42:122
271439950,4cyclictest23923-21ssh23:10:152
271439950,4cyclictest1416-21users23:55:252
271439950,4cyclictest0-21swapper/223:15:182
271439950,4cyclictest0-21swapper/220:05:142
271439950,0cyclictest0-21swapper/222:48:402
271379955,0cyclictest0-21swapper/121:14:421
271379951,2cyclictest0-21swapper/100:35:151
271379951,2cyclictest0-21swapper/100:15:201
271379950,5cyclictest0-21swapper/123:57:141
271379950,5cyclictest0-21swapper/121:28:581
271379950,5cyclictest0-21swapper/120:05:251
271379950,0cyclictest0-21swapper/123:35:591
271319954,1cyclictest0-21swapper/000:00:000
271319951,4cyclictest14792-21munin-run21:45:010
271319950,5cyclictest5266-21sh23:18:330
271319950,5cyclictest0-21swapper/023:22:300
271319950,5cyclictest0-21swapper/022:26:120
271319950,5cyclictest0-21swapper/020:24:590
271319950,5cyclictest0-21swapper/020:05:190
271319950,5cyclictest0-21swapper/000:32:460
21995250,0sleep20-21swapper/223:48:582
30802240,1sleep10-21swapper/123:14:321
271479942,2cyclictest29710-21kworker/3:221:05:023
271479941,3cyclictest29710-21kworker/3:219:30:013
271479941,3cyclictest29710-21kworker/3:219:18:003
271439944,0cyclictest0-21swapper/223:25:462
271439944,0cyclictest0-21swapper/221:17:432
271439943,1cyclictest570-21uname23:35:202
271439943,1cyclictest32374-21grep21:55:182
271439942,1cyclictest7678-21cat20:40:012
271439941,2cyclictest0-21swapper/222:15:182
271439941,2cyclictest0-21swapper/220:10:152
271439941,1cyclictest23770-21ssh22:10:152
271439941,1cyclictest0-21swapper/219:20:162
271439941,1cyclictest0-21swapper/219:10:122
271439940,4cyclictest7785-21apt-get22:40:172
271439940,4cyclictest15075-21ls22:05:002
271439940,4cyclictest14742-21ssh23:24:412
271439940,4cyclictest0-21swapper/223:05:152
271439940,4cyclictest0-21swapper/222:57:162
271439940,4cyclictest0-21swapper/222:35:172
271439940,4cyclictest0-21swapper/221:40:142
271439940,4cyclictest0-21swapper/221:35:052
271439940,4cyclictest0-21swapper/221:05:132
271439940,4cyclictest0-21swapper/219:35:152
271439940,3cyclictest5480-21sed19:30:002
271439940,3cyclictest31792-21ssh00:15:012
271439940,3cyclictest31298-21sort21:55:012
271439940,3cyclictest29711-21munin-node19:15:012
271439940,3cyclictest23949-21df21:30:202
271439940,3cyclictest22583-21diskmemload23:30:022
271439940,3cyclictest17205-21sh00:25:222
271439940,3cyclictest16331-21uname21:25:242
271439940,3cyclictest0-21swapper/223:00:172
271439940,3cyclictest0-21swapper/220:20:142
271439940,1cyclictest7948-21expr00:00:182
271439940,0cyclictest0-21swapper/221:23:162
271439940,0cyclictest0-21swapper/200:09:332
271379944,0cyclictest0-21swapper/122:44:281
271379944,0cyclictest0-21swapper/121:44:481
271379944,0cyclictest0-21swapper/120:25:121
271379944,0cyclictest0-21swapper/119:40:231
271379944,0cyclictest0-21swapper/100:14:241
271379944,0cyclictest0-21swapper/100:14:231
271379941,2cyclictest0-21swapper/122:55:171
271379941,2cyclictest0-21swapper/122:05:151
271379941,2cyclictest0-21swapper/120:50:141
271379941,2cyclictest0-21swapper/120:10:151
271379941,1cyclictest0-21swapper/122:35:161
271379941,1cyclictest0-21swapper/122:10:011
271379941,1cyclictest0-21swapper/119:35:151
271379940,4cyclictest0-21swapper/122:02:171
271379940,4cyclictest0-21swapper/121:53:331
271379940,3cyclictest0-21swapper/123:50:151
271379940,0cyclictest0-21swapper/100:26:011
271319944,0cyclictest0-21swapper/023:30:210
271319944,0cyclictest0-21swapper/021:56:470
271319940,4cyclictest54250irq/130-eth021:51:150
271319940,4cyclictest31376-21apt-get21:15:200
271319940,4cyclictest15896-21apt-get23:05:140
271319940,4cyclictest0-21swapper/022:35:160
271319940,4cyclictest0-21swapper/021:25:180
271319940,4cyclictest0-21swapper/019:51:470
271319940,4cyclictest0-21swapper/000:25:180
271319940,4cyclictest0-21swapper/000:00:510
271319940,3cyclictest9047-21memory23:00:200
271319940,3cyclictest8351-21df_inode22:40:180
271319940,3cyclictest773-21awk23:35:210
271319940,3cyclictest7468-21seq00:39:560
271319940,3cyclictest31796-21apt-get00:15:010
271319940,3cyclictest23432-21apt-config22:10:000
271319940,3cyclictest21440-21memory21:05:200
271319940,3cyclictest16377-21grep23:25:190
271319940,3cyclictest16105-21perl21:45:220
271319940,3cyclictest14790-21users19:45:280
271319940,3cyclictest0-21swapper/021:30:180
271319940,3cyclictest0-21swapper/019:20:150
271319940,2cyclictest29659-21sshd22:33:300
271319940,1cyclictest16164-21expr22:45:200
10573240,0sleep10-21swapper/100:01:191
7062230,0sleep00-21swapper/022:00:040
271479930,3cyclictest0-21swapper/319:10:123
271439932,1cyclictest31-21ksoftirqd/220:40:162
271439932,1cyclictest23964-21ssh00:30:132
271439932,1cyclictest23810-21ssh22:50:112
271439932,1cyclictest23681-21ssh23:50:122
271439931,1cyclictest20916-21forks20:00:172
271439931,1cyclictest0-21swapper/220:25:152
271439930,3cyclictest7666-21ssh22:20:152
271439930,3cyclictest13031-21tr20:50:162
271439930,3cyclictest0-21swapper/222:30:152
271439930,3cyclictest0-21swapper/222:25:112
271439930,3cyclictest0-21swapper/222:05:072
271439930,3cyclictest0-21swapper/221:45:202
271439930,3cyclictest0-21swapper/221:10:142
271439930,3cyclictest0-21swapper/220:55:052
271439930,3cyclictest0-21swapper/220:45:172
271439930,3cyclictest0-21swapper/220:15:182
271439930,3cyclictest0-21swapper/219:55:132
271439930,3cyclictest0-21swapper/219:50:152
271439930,3cyclictest0-21swapper/219:45:192
271439930,3cyclictest0-21swapper/219:40:172
271439930,3cyclictest0-21swapper/219:30:152
271439930,3cyclictest0-21swapper/200:35:022
271439930,3cyclictest0-21swapper/200:20:182
271439930,2cyclictest23517-21sh00:10:042
271439930,2cyclictest23517-21sh00:10:042
271439930,2cyclictest18210-21diskstats21:00:172
271439930,1cyclictest0-21swapper/220:30:152
271379933,0cyclictest0-21swapper/123:43:511
271379933,0cyclictest0-21swapper/122:26:091
271379931,1cyclictest0-21swapper/123:45:011
271379931,1cyclictest0-21swapper/123:25:151
271379931,1cyclictest0-21swapper/123:20:181
271379931,1cyclictest0-21swapper/123:00:141
271379931,1cyclictest0-21swapper/122:20:161
271379931,1cyclictest0-21swapper/121:35:151
271379931,1cyclictest0-21swapper/121:05:021
271379931,1cyclictest0-21swapper/119:50:161
271379931,1cyclictest0-21swapper/119:45:191
271379931,1cyclictest0-21swapper/119:10:111
271379931,1cyclictest0-21swapper/100:20:191
271379930,3cyclictest0-21swapper/120:49:471
271379930,3cyclictest0-21swapper/119:29:031
271379930,3cyclictest0-21swapper/119:20:111
271379930,2cyclictest203632sleep120:00:081
271379930,2cyclictest20135-21chrt22:47:211
271379930,2cyclictest0-21swapper/122:15:171
271379930,2cyclictest0-21swapper/121:30:191
271379930,2cyclictest0-21swapper/121:15:191
271379930,2cyclictest0-21swapper/121:00:141
271379930,2cyclictest0-21swapper/120:40:171
271379930,2cyclictest0-21swapper/119:15:171
271379930,1cyclictest0-21swapper/123:05:141
271319932,1cyclictest740-21snmpd20:10:030
271319932,1cyclictest740-21snmpd00:10:100
271319932,1cyclictest740-21snmpd00:10:100
271319932,1cyclictest614-21cpuspeed_turbos20:25:170
271319931,2cyclictest54250irq/130-eth023:50:080
271319931,1cyclictest740-21snmpd23:45:080
271319931,1cyclictest0-21swapper/020:50:150
271319931,1cyclictest0-21swapper/020:40:170
271319931,1cyclictest0-21swapper/019:30:160
271319930,3cyclictest7978-21apt-get19:35:160
271319930,3cyclictest32095-21wget22:15:180
271319930,3cyclictest15855-21perl20:55:170
271319930,3cyclictest11306-21hddtemp_smartct19:40:190
271319930,3cyclictest10249-21apt20:45:180
271319930,3cyclictest0-21swapper/023:40:020
271319930,3cyclictest0-21swapper/023:10:140
271319930,3cyclictest0-21swapper/022:05:160
271319930,3cyclictest0-21swapper/021:35:160
271319930,3cyclictest0-21swapper/021:00:140
271319930,3cyclictest0-21swapper/020:35:130
271319930,3cyclictest0-21swapper/020:15:170
271319930,3cyclictest0-21swapper/020:00:150
271319930,3cyclictest0-21swapper/019:25:140
271319930,3cyclictest0-21swapper/019:15:000
271319930,2cyclictest15380-21ssh00:05:020
271319930,1cyclictest8120-21grep00:20:220
271319930,1cyclictest7380-21sh22:20:010
271319930,1cyclictest6917-21ssh21:20:060
271319930,1cyclictest2794-21/usr/sbin/munin20:30:140
271319930,1cyclictest17880-21/usr/sbin/munin19:55:150
31157220,0sleep10-21swapper/120:20:181
271379922,0cyclictest0-21swapper/121:20:131
271379922,0cyclictest0-21swapper/120:37:531
271379921,1cyclictest0-21swapper/123:30:141
271379921,1cyclictest0-21swapper/122:30:151
271379921,1cyclictest0-21swapper/120:15:181
271379920,1cyclictest5502-21chrt19:30:151
271379920,1cyclictest1764-21chrt23:15:391
271379920,1cyclictest0-21swapper/122:50:181
271379920,1cyclictest0-21swapper/121:55:171
271379920,1cyclictest0-21swapper/120:55:141
271379920,1cyclictest0-21swapper/120:30:141
271379920,1cyclictest0-21swapper/119:55:131
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional