代码之家  ›  专栏  ›  技术社区  ›  suvayu

无法通过SSH启动dask群集

  •  0
  • suvayu  · 技术社区  · 7 年前

    我正试图通过SSH启动dask群集,但遇到了如下奇怪的错误:

    Exception in thread Thread-6:
    Traceback (most recent call last):
      File "/home/localuser/miniconda3/lib/python3.6/threading.py", line 916, in _bootstrap_inner
        self.run()
      File "/home/localuser/miniconda3/lib/python3.6/threading.py", line 864, in run
        self._target(*self._args, **self._kwargs)
      File "/home/localuser/miniconda3/lib/python3.6/site-packages/distributed/deploy/ssh.py", line 57, in async_ssh
        banner_timeout=20)  # Helps prevent timeouts when many concurrent ssh connections are opened.
      File "/home/localuser/miniconda3/lib/python3.6/site-packages/paramiko/client.py", line 329, in connect
        to_try = list(self._families_and_addresses(hostname, port))
      File "/home/localuser/miniconda3/lib/python3.6/site-packages/paramiko/client.py", line 200, in _families_and_addresses
        hostname, port, socket.AF_UNSPEC, socket.SOCK_STREAM)
      File "/home/localuser/miniconda3/lib/python3.6/socket.py", line 745, in getaddrinfo
        for res in _socket.getaddrinfo(host, port, family, type, proto, flags):
    socket.gaierror: [Errno -2] Name or service not known
    

    我这样启动集群:

    $ dask-ssh --ssh-private-key ~/.ssh/cluster_id_rsa \
          --hostfile ~/dask-hosts.txt \
          --remote-python "~/miniconda3/bin/python3.6"
    

    我的 dask-hosts.txt

    localuser@127.0.0.1
    remoteuser@10.10.4.200
    ...
    remoteuser@10.10.4.207
    

    我已经检查了ssh设置,我可以使用公钥设置登录到所有节点(密钥是未加密的,以避免出现解密提示)。我错过了什么?

    1 回复  |  直到 7 年前
        1
  •  1
  •   fuglede    7 年前

    dask-hosts.txt its documentation ,主机文件应仅包含主机名/IP地址:

    --ssh-username 设置用户名(尽管只有一个)。